[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:09 dist-test-slave-7z32 krb5kdc[22555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:09 dist-test-slave-7z32 krb5kdc[22555](info): set up 2 sockets
Aug 11 07:32:09 dist-test-slave-7z32 krb5kdc[22555](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 07:32:10.822710 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.375s user 0.003s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:10 dist-test-slave-7z32 krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:11.000418 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:46701
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:46701
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:11.179327 22571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:11.179811 22571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:11.179863 22571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:11.185109 22571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:11.185226 22571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:11.185250 22571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:11.185269 22571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:11.185287 22571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:11.194388 22571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:46701
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:46701
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:11.196255 22571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:11.197750 22571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:11.211156 22578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:11.211129 22579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:11.211129 22582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:11.211205 22571 server_base.cc:1034] running on GCE node
I20260811 07:32:11.212750 22571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:11.214668 22571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:11.218142 22571 hybrid_clock.cc:648] HybridClock initialized: now 1786433531218113 us; error 98 us; skew 500 ppm
Aug 11 07:32:11 dist-test-slave-7z32 krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433531, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:11.223512 22571 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:11.224848 22571 webserver.cc:460] Webserver started at http://127.22.4.254:42111/ using document root <none> and password file <none>
I20260811 07:32:11.225540 22571 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:11.225616 22571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:11.225816 22571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:11.228343 22571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "15975d74a9a8448ba4fc23b4ee8117c6"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "92793f9e2ab1ff494cbfaaf26c79299f"
server_key_iv: "df4c3fe450b19d7726d6329e25184fe0"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.228965 22571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "15975d74a9a8448ba4fc23b4ee8117c6"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "92793f9e2ab1ff494cbfaaf26c79299f"
server_key_iv: "df4c3fe450b19d7726d6329e25184fe0"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.234122 22571 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:32:11.238446 22592 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:11.240532 22571 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:11.240710 22571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "15975d74a9a8448ba4fc23b4ee8117c6"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "92793f9e2ab1ff494cbfaaf26c79299f"
server_key_iv: "df4c3fe450b19d7726d6329e25184fe0"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.240922 22571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:11.266166 22571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:11.270498 22571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:11.270769 22571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:11.283159 22571 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:46701
I20260811 07:32:11.283185 22679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:46701 every 8 connection(s)
I20260811 07:32:11.284466 22571 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:11.286785 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22571
I20260811 07:32:11.287104 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:11.289458 22547 external_mini_cluster.cc:1428] Setting key b85315b4009bd563669580d8465303b5
I20260811 07:32:11.290010 22681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:11.301244 22681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6: Bootstrap starting.
I20260811 07:32:11.305375 22681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:11.306875 22681 log.cc:824] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:11.311702 22681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6: No bootstrap required, opened a new log
I20260811 07:32:11.316565 22681 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15975d74a9a8448ba4fc23b4ee8117c6" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46701 } }
I20260811 07:32:11.317195 22681 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:11.317494 22681 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15975d74a9a8448ba4fc23b4ee8117c6, State: Initialized, Role: FOLLOWER
I20260811 07:32:11.318236 22681 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15975d74a9a8448ba4fc23b4ee8117c6" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46701 } }
I20260811 07:32:11.318490 22681 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:11.318588 22681 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:11.318732 22681 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:11.320212 22681 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15975d74a9a8448ba4fc23b4ee8117c6" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46701 } }
I20260811 07:32:11.320717 22681 leader_election.cc:302] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15975d74a9a8448ba4fc23b4ee8117c6; no voters:
I20260811 07:32:11.321249 22681 leader_election.cc:288] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:11.321447 22687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:11.321695 22687 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [term 1 LEADER]: Becoming Leader. State: Replica: 15975d74a9a8448ba4fc23b4ee8117c6, State: Running, Role: LEADER
I20260811 07:32:11.322222 22687 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15975d74a9a8448ba4fc23b4ee8117c6" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46701 } }
Aug 11 07:32:11 dist-test-slave-7z32 krb5kdc[22555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433530, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:11.323113 22681 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:11.325091 22693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15975d74a9a8448ba4fc23b4ee8117c6. Latest consensus state: current_term: 1 leader_uuid: "15975d74a9a8448ba4fc23b4ee8117c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15975d74a9a8448ba4fc23b4ee8117c6" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46701 } } }
I20260811 07:32:11.325104 22692 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15975d74a9a8448ba4fc23b4ee8117c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15975d74a9a8448ba4fc23b4ee8117c6" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46701 } } }
I20260811 07:32:11.325313 22692 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:11.325318 22693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:11.325996 22702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:11.330427 22702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:11.338308 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:11.295682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43414 (local address 127.22.4.254:46701)
0811 07:32:11.296630 (+ 948us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:11.296661 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:11.298477 (+ 1816us) server_negotiation.cc:407] Connection header received
0811 07:32:11.304628 (+ 6151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:11.304657 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:11.305162 (+ 505us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:11.305684 (+ 522us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:11.311584 (+ 5900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.313139 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.315851 (+ 2712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.316858 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.317255 (+ 397us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:11.324852 (+ 7597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:11.324864 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:11.324888 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:11.324956 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:11.328018 (+ 3062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:11.330156 (+ 2138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:11.330166 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:11.330177 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:11.330422 (+ 245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:11.331037 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:11.331042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:11.331044 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:11.331903 (+ 859us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:11.334882 (+ 2979us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:11.335120 (+ 238us) server_negotiation.cc:299] Negotiation successful
0811 07:32:11.335604 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":242,"threads_started":1}
I20260811 07:32:11.343214 22702 catalog_manager.cc:1347] Generated new cluster ID: 20ed76fd94934ddd8c5e2457b559e270
I20260811 07:32:11.343336 22702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:11.359303 22702 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:11.360991 22702 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:11.370314 22702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15975d74a9a8448ba4fc23b4ee8117c6: Generated new TSK 0
I20260811 07:32:11.371613 22702 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:11.424798 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46701
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:11.579430 22725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:11.579862 22725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:11.579923 22725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:11.585575 22725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:11.585690 22725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:11.585773 22725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:11.592779 22725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:11.594524 22725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:11.596086 22725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:11.608856 22731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:11.609045 22733 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:11.609258 22736 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:11.609345 22725 server_base.cc:1034] running on GCE node
I20260811 07:32:11.609886 22725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:11.610623 22725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:11.611901 22725 hybrid_clock.cc:648] HybridClock initialized: now 1786433531611858 us; error 69 us; skew 500 ppm
Aug 11 07:32:11 dist-test-slave-7z32 krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433531, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:11.615675 22725 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:11.616953 22725 webserver.cc:460] Webserver started at http://127.22.4.193:43513/ using document root <none> and password file <none>
I20260811 07:32:11.617668 22725 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:11.617745 22725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:11.618000 22725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:11.620519 22725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "66293a3f9aef460da9eac67c2090edf7"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "382e982ad0d5242d5c7b3572a8330459"
server_key_iv: "fb12960cfebde2f4ac5168d74a5b8495"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.621397 22725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "66293a3f9aef460da9eac67c2090edf7"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "382e982ad0d5242d5c7b3572a8330459"
server_key_iv: "fb12960cfebde2f4ac5168d74a5b8495"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.626912 22725 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:11.630313 22751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:11.632169 22725 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:11.632424 22725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "66293a3f9aef460da9eac67c2090edf7"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "382e982ad0d5242d5c7b3572a8330459"
server_key_iv: "fb12960cfebde2f4ac5168d74a5b8495"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.632593 22725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:11.653093 22725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:11.657189 22725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:11.657439 22725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:11.658154 22725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:11.659313 22725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:11.659395 22725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:11.659472 22725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:11.659516 22725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:11.671849 22725 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:37083
I20260811 07:32:11.671890 22928 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:37083 every 8 connection(s)
I20260811 07:32:11.672969 22725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:11.677032 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22725
I20260811 07:32:11.677233 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:11.677616 22547 external_mini_cluster.cc:1428] Setting key 1204b200faff0e0776511f5882192e73
Aug 11 07:32:11 dist-test-slave-7z32 krb5kdc[22555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433531, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:32:11.692935 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:11.675991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:43079 (local address 127.22.4.254:46701)
0811 07:32:11.676301 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:11.676307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:11.677325 (+ 1018us) server_negotiation.cc:407] Connection header received
0811 07:32:11.679345 (+ 2020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:11.679349 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:11.679417 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:11.679559 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:11.681186 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.681770 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.683093 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.683338 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.683467 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:11.686960 (+ 3493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:11.686964 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:11.686967 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:11.687003 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:11.689482 (+ 2479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:11.690444 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:11.690451 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:11.690453 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:11.690577 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:11.691233 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:11.691240 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:11.691246 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:11.691528 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:11.691678 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:11.692486 (+ 808us) server_negotiation.cc:299] Negotiation successful
0811 07:32:11.692715 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151}
I20260811 07:32:11.694491 22933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:11.676484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46701 (local address 127.22.4.193:43079)
0811 07:32:11.677120 (+ 636us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:11.677183 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:11.678973 (+ 1790us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:11.679878 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:11.679891 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:11.680373 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:11.680990 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:11.681005 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.681920 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.681923 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:11.682959 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:11.682971 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.683520 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.683524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:11.683727 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:11.684426 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:11.684444 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:11.686633 (+ 2189us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:11.689802 (+ 3169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:11.689812 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:11.689839 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:11.690285 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:11.690706 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:11.690711 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:11.690715 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:11.691057 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:11.691695 (+ 638us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:11.691737 (+ 42us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:11.692142 (+ 405us) client_negotiation.cc:769] Sending connection context
0811 07:32:11.692420 (+ 278us) client_negotiation.cc:240] Negotiation successful
0811 07:32:11.692934 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":166,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:32:11.697117 22929 heartbeater.cc:347] Connected to a master server at 127.22.4.254:46701
I20260811 07:32:11.697608 22929 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:11.698354 22929 heartbeater.cc:511] Master 127.22.4.254:46701 requested a full tablet report, sending...
I20260811 07:32:11.700954 22624 ts_manager.cc:194] Registered new tserver with Master: 66293a3f9aef460da9eac67c2090edf7 (127.22.4.193:37083)
I20260811 07:32:11.702731 22624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:43079
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:11.720518 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46701
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:11.861797 22936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:11.862197 22936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:11.862277 22936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:11.866711 22936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:11.866887 22936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:11.866997 22936 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:11.873632 22936 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:11.875164 22936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:11.877461 22936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:11.891777 22942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:11.891793 22945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:11.892190 22936 server_base.cc:1034] running on GCE node
W20260811 07:32:11.891793 22943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:11.893131 22936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:11.894203 22936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:11.895550 22936 hybrid_clock.cc:648] HybridClock initialized: now 1786433531895494 us; error 75 us; skew 500 ppm
Aug 11 07:32:11 dist-test-slave-7z32 krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433531, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:11.900000 22936 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:11.901417 22936 webserver.cc:460] Webserver started at http://127.22.4.194:36761/ using document root <none> and password file <none>
I20260811 07:32:11.902191 22936 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:11.902268 22936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:11.902508 22936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:11.905418 22936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "e32880878043442fa9837fa36c0c6095"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "71816d01786a29e049dd39b8f453a8f3"
server_key_iv: "d8acf7f60b33fdbfb4c2bfbc7822c8a7"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.906165 22936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "e32880878043442fa9837fa36c0c6095"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "71816d01786a29e049dd39b8f453a8f3"
server_key_iv: "d8acf7f60b33fdbfb4c2bfbc7822c8a7"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.911872 22936 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:32:11.915844 22956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:11.917806 22936 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:11.917995 22936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "e32880878043442fa9837fa36c0c6095"
format_stamp: "Formatted at 2026-08-11 07:32:11 on dist-test-slave-7z32"
server_key: "71816d01786a29e049dd39b8f453a8f3"
server_key_iv: "d8acf7f60b33fdbfb4c2bfbc7822c8a7"
server_key_version: "encryptionkey@0"
I20260811 07:32:11.918228 22936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:11.932742 22936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:11.937698 22936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:11.938000 22936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:11.938949 22936 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:11.940214 22936 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:11.940315 22936 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:11.940478 22936 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:11.940531 22936 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:11.954996 22936 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:40161
I20260811 07:32:11.955022 23126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:40161 every 8 connection(s)
I20260811 07:32:11.956779 22936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:11.963024 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22936
I20260811 07:32:11.963191 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:11.963608 22547 external_mini_cluster.cc:1428] Setting key 5bab472b524003ca63f71392de7982d9
Aug 11 07:32:11 dist-test-slave-7z32 krb5kdc[22555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433531, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:11.979100 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:11.959608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:56931 (local address 127.22.4.254:46701)
0811 07:32:11.959845 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:11.959851 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:11.961491 (+ 1640us) server_negotiation.cc:407] Connection header received
0811 07:32:11.962684 (+ 1193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:11.962689 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:11.962775 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:11.963007 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:11.965179 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.965938 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.968211 (+ 2273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.968518 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.968662 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:11.972781 (+ 4119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:11.972789 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:11.972796 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:11.972853 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:11.975352 (+ 2499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:11.976238 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:11.976245 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:11.976249 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:11.976390 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:11.976892 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:11.976899 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:11.976903 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:11.977273 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:11.977424 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:11.978564 (+ 1140us) server_negotiation.cc:299] Negotiation successful
0811 07:32:11.978757 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:11.980410 23129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:11.960182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46701 (local address 127.22.4.194:56931)
0811 07:32:11.961239 (+ 1057us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:11.961308 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:11.962298 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:11.963355 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:11.963368 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:11.964016 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:11.964839 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:11.964944 (+ 105us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.966218 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.966223 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:11.967932 (+ 1709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:11.967953 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:11.968745 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:11.968751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:11.969055 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:11.970021 (+ 966us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:11.970052 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:11.972455 (+ 2403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:11.975630 (+ 3175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:11.975638 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:11.975658 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:11.976077 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:11.976553 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:11.976556 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:11.976558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:11.976749 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:11.977520 (+ 771us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:11.977531 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:11.978170 (+ 639us) client_negotiation.cc:769] Sending connection context
0811 07:32:11.978437 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 07:32:11.978960 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":708,"thread_start_us":159,"threads_started":1}
I20260811 07:32:11.982792 23127 heartbeater.cc:347] Connected to a master server at 127.22.4.254:46701
I20260811 07:32:11.983237 23127 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:32:11.984045 23127 heartbeater.cc:511] Master 127.22.4.254:46701 requested a full tablet report, sending...
I20260811 07:32:11.985801 22624 ts_manager.cc:194] Registered new tserver with Master: e32880878043442fa9837fa36c0c6095 (127.22.4.194:40161)
I20260811 07:32:11.986528 22624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:56931
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:12.008364 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46701
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:12.173615 23133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:12.174041 23133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:12.174119 23133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:12.178509 23133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:12.178676 23133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:12.178792 23133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:12.186985 23133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46701
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:12.189069 23133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:12.190697 23133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:12.205734 23141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:12.205724 23146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:12.206079 23133 server_base.cc:1034] running on GCE node
W20260811 07:32:12.205734 23140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:12.207023 23133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:12.208033 23133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:12.209348 23133 hybrid_clock.cc:648] HybridClock initialized: now 1786433532209312 us; error 61 us; skew 500 ppm
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433532, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:12.213758 23133 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:12.215355 23133 webserver.cc:460] Webserver started at http://127.22.4.195:44125/ using document root <none> and password file <none>
I20260811 07:32:12.216198 23133 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:12.216305 23133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:12.216619 23133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:12.219749 23133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "7652ec45228549719b6a790cbf8ff963"
format_stamp: "Formatted at 2026-08-11 07:32:12 on dist-test-slave-7z32"
server_key: "d2a3aeb84484e2c686fb23687904c7a9"
server_key_iv: "6f79be41cf78ab6cf79f12f58fa05caf"
server_key_version: "encryptionkey@0"
I20260811 07:32:12.220603 23133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "7652ec45228549719b6a790cbf8ff963"
format_stamp: "Formatted at 2026-08-11 07:32:12 on dist-test-slave-7z32"
server_key: "d2a3aeb84484e2c686fb23687904c7a9"
server_key_iv: "6f79be41cf78ab6cf79f12f58fa05caf"
server_key_version: "encryptionkey@0"
I20260811 07:32:12.226758 23133 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 07:32:12.230628 23163 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:12.232599 23133 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:12.232820 23133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "7652ec45228549719b6a790cbf8ff963"
format_stamp: "Formatted at 2026-08-11 07:32:12 on dist-test-slave-7z32"
server_key: "d2a3aeb84484e2c686fb23687904c7a9"
server_key_iv: "6f79be41cf78ab6cf79f12f58fa05caf"
server_key_version: "encryptionkey@0"
I20260811 07:32:12.232995 23133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:12.253916 23133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:12.258677 23133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:12.258984 23133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:12.259820 23133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:12.261087 23133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:12.261174 23133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:12.261267 23133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:12.261318 23133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:12.273521 23133 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:36203
I20260811 07:32:12.273629 23371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:36203 every 8 connection(s)
I20260811 07:32:12.274896 23133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:12.282245 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23133
I20260811 07:32:12.282424 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:12.282790 22547 external_mini_cluster.cc:1428] Setting key f88984926eaec8ecacd10942532eed83
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[22555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433532, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:12.293715 22684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:12.277809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:38291 (local address 127.22.4.254:46701)
0811 07:32:12.278089 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:12.278094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:12.279663 (+ 1569us) server_negotiation.cc:407] Connection header received
0811 07:32:12.280825 (+ 1162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:12.280829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:12.280897 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:12.281016 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:12.282533 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:12.283248 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:12.284914 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:12.285321 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:12.285453 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:12.288736 (+ 3283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:12.288741 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:12.288745 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:12.288785 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:12.290796 (+ 2011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:12.291512 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:12.291516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:12.291518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:12.291634 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:12.292231 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:12.292235 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:12.292237 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:12.292517 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:12.292630 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:12.293327 (+ 697us) server_negotiation.cc:299] Negotiation successful
0811 07:32:12.293513 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 07:32:12.294759 23374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:12.278289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46701 (local address 127.22.4.195:38291)
0811 07:32:12.279448 (+ 1159us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:12.279511 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:12.280563 (+ 1052us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:12.281253 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:12.281261 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:12.281714 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:12.282294 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:12.282312 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:12.283405 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:12.283407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:12.284732 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:12.284744 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:12.285520 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:12.285524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:12.285738 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:12.286767 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:12.286786 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:12.288533 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:12.291022 (+ 2489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:12.291028 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:12.291046 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:12.291388 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:12.291770 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:12.291773 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:12.291774 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:12.292116 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:12.292664 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:12.292670 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:12.293017 (+ 347us) client_negotiation.cc:769] Sending connection context
0811 07:32:12.293247 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 07:32:12.293645 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"thread_start_us":203,"threads_started":1}
I20260811 07:32:12.296418 23372 heartbeater.cc:347] Connected to a master server at 127.22.4.254:46701
I20260811 07:32:12.296927 23372 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:12.297725 23372 heartbeater.cc:511] Master 127.22.4.254:46701 requested a full tablet report, sending...
I20260811 07:32:12.299278 22624 ts_manager.cc:194] Registered new tserver with Master: 7652ec45228549719b6a790cbf8ff963 (127.22.4.195:36203)
I20260811 07:32:12.300002 22624 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:38291
I20260811 07:32:12.312269 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433532, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[22555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433532, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:12.350100 23380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:12.335960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38642 (local address 127.22.4.193:37083)
0811 07:32:12.336491 (+ 531us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:12.336501 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:12.336539 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:32:12.336627 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:12.336634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:12.336916 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:12.337105 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:12.338188 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:12.339293 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:12.340284 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:12.340824 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:12.340964 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:12.344663 (+ 3699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:12.344681 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:12.344770 (+ 89us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:12.344822 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:12.347253 (+ 2431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:12.347923 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:12.347932 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:12.347933 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:12.348052 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:12.348547 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:12.348551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:12.348553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:12.348917 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:12.349159 (+ 242us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:12.349439 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 07:32:12.349775 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":144,"threads_started":1}
W20260811 07:32:12.352094 22789 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38642
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[22555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433532, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[22555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433532, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:12.390012 23380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:12.378562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38652 (local address 127.22.4.193:37083)
0811 07:32:12.378935 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:12.378940 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:12.379029 (+ 89us) server_negotiation.cc:407] Connection header received
0811 07:32:12.379262 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:12.379267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:12.379330 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:12.379429 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:12.380446 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:12.381271 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:12.382387 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:12.382624 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:12.382752 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:12.385974 (+ 3222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:12.385980 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:12.385982 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:12.386033 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:12.387777 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:12.388330 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:12.388334 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:12.388336 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:12.388441 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:12.388867 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:12.388871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:12.388872 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:12.389130 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:12.389303 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:12.389684 (+ 381us) server_negotiation.cc:299] Negotiation successful
0811 07:32:12.389841 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260811 07:32:12.391685 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22725
I20260811 07:32:12.418792 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22936
I20260811 07:32:12.452737 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23133
I20260811 07:32:12.471783 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22571
2026-08-11T07:32:12Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3068 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[23391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[23391](info): set up 2 sockets
Aug 11 07:32:12 dist-test-slave-7z32 krb5kdc[23391](info): commencing operation
krb5kdc: starting...
W20260811 07:32:13.812045 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.306s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:13 dist-test-slave-7z32 krb5kdc[23391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:13.976763 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37663
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:40467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:37663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:14.135697 23407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:14.136150 23407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:14.136204 23407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:14.141667 23407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:14.141850 23407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:14.141882 23407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:14.141917 23407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:14.141955 23407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:14.149716 23407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:37663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:14.151630 23407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:14.153759 23407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:14.166916 23413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:14.166896 23419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:14.166896 23415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:14.167243 23407 server_base.cc:1034] running on GCE node
I20260811 07:32:14.168373 23407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:14.170030 23407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:14.173415 23407 hybrid_clock.cc:648] HybridClock initialized: now 1786433534173343 us; error 77 us; skew 500 ppm
Aug 11 07:32:14 dist-test-slave-7z32 krb5kdc[23391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:14.177928 23407 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:14.179478 23407 webserver.cc:460] Webserver started at http://127.22.4.254:35895/ using document root <none> and password file <none>
I20260811 07:32:14.180276 23407 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:14.180356 23407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:14.180683 23407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:14.184389 23407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "8f5ac190842d4ddfa7edf8c67d44215c"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "2f824b199d6caeb9217eece2cc124bd0"
server_key_iv: "d5ae5d8fabd35c7eb5d462ccf7952e10"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.185257 23407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "8f5ac190842d4ddfa7edf8c67d44215c"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "2f824b199d6caeb9217eece2cc124bd0"
server_key_iv: "d5ae5d8fabd35c7eb5d462ccf7952e10"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.191543 23407 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:32:14.195947 23427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:14.198282 23407 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:32:14.198590 23407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "8f5ac190842d4ddfa7edf8c67d44215c"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "2f824b199d6caeb9217eece2cc124bd0"
server_key_iv: "d5ae5d8fabd35c7eb5d462ccf7952e10"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.198813 23407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:14.243594 23407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:14.248214 23407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:14.248528 23407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:14.259008 23407 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:37663
I20260811 07:32:14.259068 23532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:37663 every 8 connection(s)
I20260811 07:32:14.260639 23407 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:14.262683 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23407
I20260811 07:32:14.262882 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:14.263279 22547 external_mini_cluster.cc:1428] Setting key 05a86133b74684930b54c6c8e63861fa
I20260811 07:32:14.265033 23533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:14.274053 23533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c: Bootstrap starting.
Aug 11 07:32:14 dist-test-slave-7z32 krb5kdc[23391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:14.277355 23533 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:14.278400 23533 log.cc:824] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:14.280869 23533 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c: No bootstrap required, opened a new log
I20260811 07:32:14.283039 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:14.265421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48028 (local address 127.22.4.254:37663)
0811 07:32:14.266085 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:14.266116 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:14.266175 (+ 59us) server_negotiation.cc:407] Connection header received
0811 07:32:14.267538 (+ 1363us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:14.267573 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:14.268205 (+ 632us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:14.268631 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:14.269814 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.271097 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.272444 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.273090 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.273261 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:14.276841 (+ 3580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:14.276850 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:14.276876 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:14.276925 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:14.279291 (+ 2366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:14.279903 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:14.279909 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:14.279917 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:14.280058 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:14.280379 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:14.280382 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:14.280386 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:14.280989 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:14.281233 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:14.281567 (+ 334us) server_negotiation.cc:299] Negotiation successful
0811 07:32:14.281967 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":226,"threads_started":1}
I20260811 07:32:14.285398 23533 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5ac190842d4ddfa7edf8c67d44215c" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37663 } }
I20260811 07:32:14.285745 23533 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:14.285815 23533 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f5ac190842d4ddfa7edf8c67d44215c, State: Initialized, Role: FOLLOWER
I20260811 07:32:14.286401 23533 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5ac190842d4ddfa7edf8c67d44215c" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37663 } }
I20260811 07:32:14.286584 23533 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:14.286648 23533 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:14.286732 23533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:14.288017 23533 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5ac190842d4ddfa7edf8c67d44215c" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37663 } }
I20260811 07:32:14.288462 23533 leader_election.cc:302] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f5ac190842d4ddfa7edf8c67d44215c; no voters:
I20260811 07:32:14.288870 23533 leader_election.cc:288] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:14.289083 23541 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:14.289446 23541 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [term 1 LEADER]: Becoming Leader. State: Replica: 8f5ac190842d4ddfa7edf8c67d44215c, State: Running, Role: LEADER
I20260811 07:32:14.289927 23541 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5ac190842d4ddfa7edf8c67d44215c" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37663 } }
I20260811 07:32:14.290522 23533 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:14.292160 23546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f5ac190842d4ddfa7edf8c67d44215c. Latest consensus state: current_term: 1 leader_uuid: "8f5ac190842d4ddfa7edf8c67d44215c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5ac190842d4ddfa7edf8c67d44215c" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37663 } } }
I20260811 07:32:14.292335 23546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:14.292739 23543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f5ac190842d4ddfa7edf8c67d44215c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f5ac190842d4ddfa7edf8c67d44215c" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37663 } } }
I20260811 07:32:14.292842 23543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:14.293152 23562 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:14.297835 23562 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:14.306397 23562 catalog_manager.cc:1347] Generated new cluster ID: 397f41259ec94f5a8c65fb0e7c5bd129
I20260811 07:32:14.306545 23562 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:14.320595 23562 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:14.322199 23562 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:14.329286 23562 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f5ac190842d4ddfa7edf8c67d44215c: Generated new TSK 0
I20260811 07:32:14.330744 23562 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:14.380028 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37663
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:40467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:14.541101 23578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:14.541535 23578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:14.541646 23578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:14.546448 23578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:14.546569 23578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:14.546644 23578 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:14.554280 23578 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37663
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:14.556125 23578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:14.557629 23578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:14.571346 23588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:14.571346 23590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:14.571384 23587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:14.571784 23578 server_base.cc:1034] running on GCE node
I20260811 07:32:14.572415 23578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:14.573385 23578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:14.574608 23578 hybrid_clock.cc:648] HybridClock initialized: now 1786433534574580 us; error 53 us; skew 500 ppm
Aug 11 07:32:14 dist-test-slave-7z32 krb5kdc[23391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:14.583331 23578 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:14.585002 23578 webserver.cc:460] Webserver started at http://127.22.4.193:38323/ using document root <none> and password file <none>
I20260811 07:32:14.585896 23578 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:14.586020 23578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:14.586354 23578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:14.589670 23578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "17599b7517e944b0ab6965eb6b4acb9d"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "6bc848efffc79547eee7f3ae774b2c6a"
server_key_iv: "284234f472b202adf09ed9e9c8bcb7aa"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.590471 23578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "17599b7517e944b0ab6965eb6b4acb9d"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "6bc848efffc79547eee7f3ae774b2c6a"
server_key_iv: "284234f472b202adf09ed9e9c8bcb7aa"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.596761 23578 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s
I20260811 07:32:14.600813 23604 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:14.602790 23578 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:14.603155 23578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "17599b7517e944b0ab6965eb6b4acb9d"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "6bc848efffc79547eee7f3ae774b2c6a"
server_key_iv: "284234f472b202adf09ed9e9c8bcb7aa"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.603343 23578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:14.620317 23578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:14.625391 23578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:14.625747 23578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:14.626710 23578 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:14.628033 23578 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:14.628124 23578 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:14.628216 23578 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:14.628268 23578 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:14.644439 23578 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:36119
I20260811 07:32:14.644565 23790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:36119 every 8 connection(s)
I20260811 07:32:14.645901 23578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:14.653980 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23578
I20260811 07:32:14.654114 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:14.654470 22547 external_mini_cluster.cc:1428] Setting key 41e262c5d5edbf6dc4cdd9845d610640
Aug 11 07:32:14 dist-test-slave-7z32 krb5kdc[23391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:32:14.667111 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:14.648998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:40865 (local address 127.22.4.254:37663)
0811 07:32:14.649218 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:14.649223 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:14.650680 (+ 1457us) server_negotiation.cc:407] Connection header received
0811 07:32:14.652657 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:14.652662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:14.652751 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:14.652878 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:14.654940 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.655697 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.657175 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.657444 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.657572 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:14.661590 (+ 4018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:14.661594 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:14.661596 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:14.661634 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:14.663860 (+ 2226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:14.664763 (+ 903us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:14.664767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:14.664769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:14.664877 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:14.665370 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:14.665374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:14.665375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:14.665645 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:14.665786 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:14.666642 (+ 856us) server_negotiation.cc:299] Negotiation successful
0811 07:32:14.666883 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 07:32:14.668613 23793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:14.649541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37663 (local address 127.22.4.193:40865)
0811 07:32:14.650367 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:14.650439 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:14.652289 (+ 1850us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:14.653194 (+ 905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:14.653206 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:14.653762 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:14.654649 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:14.654675 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.655875 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.655879 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:14.657004 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:14.657016 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.657639 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.657644 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:14.657871 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:14.658735 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:14.658756 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:14.661275 (+ 2519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:14.664070 (+ 2795us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:14.664082 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:14.664123 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:14.664570 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:14.664996 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:14.665000 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:14.665003 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:14.665226 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:14.665799 (+ 573us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:14.665811 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:14.666284 (+ 473us) client_negotiation.cc:769] Sending connection context
0811 07:32:14.666580 (+ 296us) client_negotiation.cc:240] Negotiation successful
0811 07:32:14.667144 (+ 564us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":205,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:32:14.670867 23791 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37663
I20260811 07:32:14.671191 23791 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:14.672021 23791 heartbeater.cc:511] Master 127.22.4.254:37663 requested a full tablet report, sending...
I20260811 07:32:14.674535 23460 ts_manager.cc:194] Registered new tserver with Master: 17599b7517e944b0ab6965eb6b4acb9d (127.22.4.193:36119)
I20260811 07:32:14.676285 23460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:40865
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:14.692036 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37663
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:40467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:14.833214 23796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:14.833564 23796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:14.833614 23796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:14.838232 23796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:14.838379 23796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:14.838451 23796 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:14.844892 23796 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37663
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23796
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:14.846216 23796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:14.847546 23796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:14.859863 23808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:14.859863 23804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:14.860054 23802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:14.860409 23796 server_base.cc:1034] running on GCE node
I20260811 07:32:14.860862 23796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:14.861657 23796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:14.862932 23796 hybrid_clock.cc:648] HybridClock initialized: now 1786433534862892 us; error 54 us; skew 500 ppm
Aug 11 07:32:14 dist-test-slave-7z32 krb5kdc[23391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:14.866194 23796 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:14.867496 23796 webserver.cc:460] Webserver started at http://127.22.4.194:45007/ using document root <none> and password file <none>
I20260811 07:32:14.868172 23796 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:14.868247 23796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:14.868441 23796 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:14.870790 23796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "8e62abbca40a4372a80e698923260782"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "1dac2ee1b1f3d990a238d6bd76d9cc72"
server_key_iv: "324c329b16ac5d98cc8aec6510577b92"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.871547 23796 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "8e62abbca40a4372a80e698923260782"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "1dac2ee1b1f3d990a238d6bd76d9cc72"
server_key_iv: "324c329b16ac5d98cc8aec6510577b92"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.876511 23796 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:32:14.879963 23817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:14.881909 23796 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:14.882092 23796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "8e62abbca40a4372a80e698923260782"
format_stamp: "Formatted at 2026-08-11 07:32:14 on dist-test-slave-7z32"
server_key: "1dac2ee1b1f3d990a238d6bd76d9cc72"
server_key_iv: "324c329b16ac5d98cc8aec6510577b92"
server_key_version: "encryptionkey@0"
I20260811 07:32:14.882239 23796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:14.901461 23796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:14.905449 23796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:14.905684 23796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:14.906400 23796 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:14.907502 23796 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:14.907586 23796 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:14.907665 23796 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:14.907712 23796 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:14.919507 23796 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:40031
I20260811 07:32:14.919603 24008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:40031 every 8 connection(s)
I20260811 07:32:14.920646 23796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:14.922684 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23796
I20260811 07:32:14.922828 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:14.923372 22547 external_mini_cluster.cc:1428] Setting key 378604cb9bd9f3ba8812fc975cf3e658
Aug 11 07:32:14 dist-test-slave-7z32 krb5kdc[23391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433534, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:14.939321 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:14.923517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:44921 (local address 127.22.4.254:37663)
0811 07:32:14.923725 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:14.923732 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:14.925327 (+ 1595us) server_negotiation.cc:407] Connection header received
0811 07:32:14.926988 (+ 1661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:14.926997 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:14.927082 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:14.927221 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:14.928791 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.929361 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.930614 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.930914 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.931035 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:14.934565 (+ 3530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:14.934569 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:14.934571 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:14.934602 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:14.936299 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:14.937201 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:14.937205 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:14.937206 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:14.937293 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:14.937796 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:14.937799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:14.937800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:14.938070 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:14.938160 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:14.939024 (+ 864us) server_negotiation.cc:299] Negotiation successful
0811 07:32:14.939175 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:32:14.940747 24013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:14.924242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37663 (local address 127.22.4.194:44921)
0811 07:32:14.925070 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:14.925131 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:14.926660 (+ 1529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:14.927465 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:14.927473 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:14.927937 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:14.928582 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:14.928600 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.929517 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.929521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:14.930464 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:14.930474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:14.931092 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:14.931096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:14.931277 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:14.931945 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:14.931964 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:14.934170 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:14.936470 (+ 2300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:14.936480 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:14.936507 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:14.937056 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:14.937413 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:14.937417 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:14.937421 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:14.937674 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:14.938203 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:14.938216 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:14.938640 (+ 424us) client_negotiation.cc:769] Sending connection context
0811 07:32:14.938974 (+ 334us) client_negotiation.cc:240] Negotiation successful
0811 07:32:14.939381 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":276,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:32:14.942438 24010 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37663
I20260811 07:32:14.942929 24010 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:14.943672 24010 heartbeater.cc:511] Master 127.22.4.254:37663 requested a full tablet report, sending...
I20260811 07:32:14.945360 23460 ts_manager.cc:194] Registered new tserver with Master: 8e62abbca40a4372a80e698923260782 (127.22.4.194:40031)
I20260811 07:32:14.946262 23460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:44921
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:14.968271 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37663
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:40467
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:15.119143 24016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:15.119644 24016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:15.119747 24016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:15.124555 24016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:15.124719 24016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:15.124843 24016 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:15.131206 24016 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40467
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37663
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:15.132874 24016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:15.134305 24016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:15.147235 24023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:15.147233 24016 server_base.cc:1034] running on GCE node
W20260811 07:32:15.147358 24025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:15.147248 24021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:15.148566 24016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:15.149677 24016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:15.150986 24016 hybrid_clock.cc:648] HybridClock initialized: now 1786433535150939 us; error 70 us; skew 500 ppm
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[23391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433535, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:15.155515 24016 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:15.157132 24016 webserver.cc:460] Webserver started at http://127.22.4.195:40761/ using document root <none> and password file <none>
I20260811 07:32:15.157990 24016 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:15.158124 24016 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:15.158460 24016 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:15.161466 24016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "a45c2eba6d374bf38519979705438714"
format_stamp: "Formatted at 2026-08-11 07:32:15 on dist-test-slave-7z32"
server_key: "221a11adc6a8873461bd3776aab8447a"
server_key_iv: "9401f4220af7cbfeac01dca119d856a1"
server_key_version: "encryptionkey@0"
I20260811 07:32:15.162212 24016 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "a45c2eba6d374bf38519979705438714"
format_stamp: "Formatted at 2026-08-11 07:32:15 on dist-test-slave-7z32"
server_key: "221a11adc6a8873461bd3776aab8447a"
server_key_iv: "9401f4220af7cbfeac01dca119d856a1"
server_key_version: "encryptionkey@0"
I20260811 07:32:15.167814 24016 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:32:15.172034 24035 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:15.174083 24016 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:32:15.174347 24016 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "a45c2eba6d374bf38519979705438714"
format_stamp: "Formatted at 2026-08-11 07:32:15 on dist-test-slave-7z32"
server_key: "221a11adc6a8873461bd3776aab8447a"
server_key_iv: "9401f4220af7cbfeac01dca119d856a1"
server_key_version: "encryptionkey@0"
I20260811 07:32:15.174540 24016 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:15.194432 24016 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:15.199245 24016 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:15.199530 24016 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:15.200387 24016 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:15.201620 24016 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:15.201702 24016 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:15.201784 24016 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:15.201833 24016 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:15.216452 24016 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:44879
I20260811 07:32:15.216480 24220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:44879 every 8 connection(s)
I20260811 07:32:15.218027 24016 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:15.219775 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24016
I20260811 07:32:15.219947 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:15.220266 22547 external_mini_cluster.cc:1428] Setting key 08303b87ec82ad1e4b971d5c80926e50
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[23391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433535, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:15.238363 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.221486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:42079 (local address 127.22.4.254:37663)
0811 07:32:15.221695 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.221701 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.223380 (+ 1679us) server_negotiation.cc:407] Connection header received
0811 07:32:15.225239 (+ 1859us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.225243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.225338 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.225439 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:15.226998 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.227605 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.228933 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.229187 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.229301 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.232478 (+ 3177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:15.232482 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:15.232484 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:15.232524 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:15.235058 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.236020 (+ 962us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.236026 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.236028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.236169 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.236761 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.236765 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.236767 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.237130 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:15.237268 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.238022 (+ 754us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.238187 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:32:15.239473 24224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.222208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37663 (local address 127.22.4.195:42079)
0811 07:32:15.223114 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:15.223205 (+ 91us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:15.224961 (+ 1756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:15.225706 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:15.225714 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:15.226161 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:15.226802 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.226819 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.227757 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.227760 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.228786 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.228798 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.229367 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.229370 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.229573 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.230297 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:15.230316 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:15.232231 (+ 1915us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:15.235223 (+ 2992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:15.235234 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:15.235266 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:15.235826 (+ 560us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:15.236320 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:15.236323 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:15.236325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:15.236613 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:15.237307 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:15.237316 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:15.237724 (+ 408us) client_negotiation.cc:769] Sending connection context
0811 07:32:15.237926 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 07:32:15.238294 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":240,"threads_started":1}
I20260811 07:32:15.241678 24221 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37663
I20260811 07:32:15.242183 24221 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:15.243477 24221 heartbeater.cc:511] Master 127.22.4.254:37663 requested a full tablet report, sending...
I20260811 07:32:15.245249 23460 ts_manager.cc:194] Registered new tserver with Master: a45c2eba6d374bf38519979705438714 (127.22.4.195:44879)
I20260811 07:32:15.246174 23460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:42079
I20260811 07:32:15.249518 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:32:15.264715 23537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.254287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48044 (local address 127.22.4.254:37663)
0811 07:32:15.254480 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.254485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.254771 (+ 286us) server_negotiation.cc:407] Connection header received
0811 07:32:15.255008 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.255011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.255067 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.255149 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:15.256163 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.256717 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.257715 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.257957 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.258068 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.260003 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:15.260007 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:15.260010 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:15.260041 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:15.262380 (+ 2339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.263150 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.263154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.263156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.263275 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.263603 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.263607 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.263609 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.263931 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:15.264075 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.264384 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.264539 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 07:32:15.272224 23460 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48044:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:15.276669 23460 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:15.298702 24234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.289232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:44879 (local address 127.0.0.1:40396)
0811 07:32:15.291021 (+ 1789us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:15.291100 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:15.291333 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:15.292941 (+ 1608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:15.292949 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:15.292988 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:15.293360 (+ 372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.293372 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.294927 (+ 1555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.294934 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.296635 (+ 1701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.296649 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.298035 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.298039 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.298172 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.298230 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 07:32:15.298355 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 07:32:15.298493 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1470,"mutex_wait_us":256,"spinlock_wait_cycles":4992,"thread_start_us":1310,"threads_started":1}
I20260811 07:32:15.298944 24239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.291437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36119 (local address 127.0.0.1:51222)
0811 07:32:15.292236 (+ 799us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:15.292253 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:15.292367 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:15.293081 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:15.293084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:15.293094 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:15.293405 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.293415 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.295173 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.295178 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.296913 (+ 1735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.296930 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.298403 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.298407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.298509 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.298540 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:32:15.298629 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:32:15.298738 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":197,"thread_start_us":154,"threads_started":1}
I20260811 07:32:15.299163 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.291625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51222 (local address 127.22.4.193:36119)
0811 07:32:15.292099 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.292105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.292485 (+ 380us) server_negotiation.cc:407] Connection header received
0811 07:32:15.292587 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.292592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.292788 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.292966 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:15.293577 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.294955 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.297138 (+ 2183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.298021 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.298137 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.298326 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.298748 (+ 422us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.298960 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":172,"threads_started":1}
I20260811 07:32:15.299319 24235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.289294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:40031 (local address 127.0.0.1:55684)
0811 07:32:15.291751 (+ 2457us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:15.291769 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:15.291882 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:15.292941 (+ 1059us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:15.292949 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:15.292982 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:15.293525 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.293539 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.295344 (+ 1805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.295347 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.296913 (+ 1566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.296940 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.297918 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.297922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.298953 (+ 1031us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.298983 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:32:15.299065 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:32:15.299152 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2376,"mutex_wait_us":383,"thread_start_us":1114,"threads_started":1}
I20260811 07:32:15.299778 24238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.291166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55684 (local address 127.22.4.194:40031)
0811 07:32:15.292045 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.292059 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.292093 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:32:15.292203 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.292209 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.292468 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.292652 (+ 184us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:15.293701 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.295181 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.297111 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.297742 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.297905 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.298094 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.299520 (+ 1426us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.299640 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":187,"threads_started":1}
I20260811 07:32:15.303040 23683 tablet_service.cc:1467] Processing CreateTablet for tablet 31d5d005f43d40f3b378fa4f852930ac (DEFAULT_TABLE table=test-table [id=0b46629c66524c5692d0b1722f8f75a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:15.303828 24237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.289372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40396 (local address 127.22.4.195:44879)
0811 07:32:15.292238 (+ 2866us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.292260 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.292300 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:32:15.292410 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.292420 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.292769 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.292966 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:15.293558 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.294619 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.296806 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.297835 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.298113 (+ 278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.298326 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.298422 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.298566 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2705,"thread_start_us":1052,"threads_started":1}
I20260811 07:32:15.303360 23897 tablet_service.cc:1467] Processing CreateTablet for tablet 31d5d005f43d40f3b378fa4f852930ac (DEFAULT_TABLE table=test-table [id=0b46629c66524c5692d0b1722f8f75a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:15.304556 23683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d5d005f43d40f3b378fa4f852930ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:15.305083 23897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d5d005f43d40f3b378fa4f852930ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:15.308359 24109 tablet_service.cc:1467] Processing CreateTablet for tablet 31d5d005f43d40f3b378fa4f852930ac (DEFAULT_TABLE table=test-table [id=0b46629c66524c5692d0b1722f8f75a9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:15.309940 24109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31d5d005f43d40f3b378fa4f852930ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:15.312824 24243 tablet_bootstrap.cc:492] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d: Bootstrap starting.
I20260811 07:32:15.315533 24243 tablet_bootstrap.cc:654] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:15.316485 24243 log.cc:824] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:15.317229 24244 tablet_bootstrap.cc:492] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782: Bootstrap starting.
I20260811 07:32:15.319432 24243 tablet_bootstrap.cc:492] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d: No bootstrap required, opened a new log
I20260811 07:32:15.319717 24243 ts_tablet_manager.cc:1397] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:32:15.320226 24246 tablet_bootstrap.cc:492] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714: Bootstrap starting.
I20260811 07:32:15.321187 24244 tablet_bootstrap.cc:654] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:15.322417 24244 log.cc:824] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:15.323632 24246 tablet_bootstrap.cc:654] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:15.325214 24244 tablet_bootstrap.cc:492] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782: No bootstrap required, opened a new log
I20260811 07:32:15.325538 24244 ts_tablet_manager.cc:1397] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260811 07:32:15.325665 24246 log.cc:824] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:15.327296 24243 raft_consensus.cc:348] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.327699 24243 raft_consensus.cc:374] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:15.327781 24243 raft_consensus.cc:729] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17599b7517e944b0ab6965eb6b4acb9d, State: Initialized, Role: FOLLOWER
I20260811 07:32:15.328291 24246 tablet_bootstrap.cc:492] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714: No bootstrap required, opened a new log
I20260811 07:32:15.328423 24243 consensus_queue.cc:260] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.328568 24246 ts_tablet_manager.cc:1397] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 07:32:15.329429 23791 heartbeater.cc:503] Master 127.22.4.254:37663 was elected leader, sending a full tablet report...
I20260811 07:32:15.329903 24243 ts_tablet_manager.cc:1428] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260811 07:32:15.330251 24244 raft_consensus.cc:348] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.330616 24244 raft_consensus.cc:374] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:15.330678 24244 raft_consensus.cc:729] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e62abbca40a4372a80e698923260782, State: Initialized, Role: FOLLOWER
I20260811 07:32:15.331308 24244 consensus_queue.cc:260] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.332185 24010 heartbeater.cc:503] Master 127.22.4.254:37663 was elected leader, sending a full tablet report...
I20260811 07:32:15.332607 24244 ts_tablet_manager.cc:1428] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:32:15.334599 24246 raft_consensus.cc:348] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.335008 24246 raft_consensus.cc:374] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:15.335083 24246 raft_consensus.cc:729] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a45c2eba6d374bf38519979705438714, State: Initialized, Role: FOLLOWER
I20260811 07:32:15.335619 24246 consensus_queue.cc:260] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.336619 24221 heartbeater.cc:503] Master 127.22.4.254:37663 was elected leader, sending a full tablet report...
I20260811 07:32:15.336935 24246 ts_tablet_manager.cc:1428] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 07:32:15.357131 24251 raft_consensus.cc:482] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:15.357493 24251 raft_consensus.cc:504] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.359598 24251 leader_election.cc:288] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 17599b7517e944b0ab6965eb6b4acb9d (127.22.4.193:36119), 8e62abbca40a4372a80e698923260782 (127.22.4.194:40031)
I20260811 07:32:15.364850 24238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.360230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:51237 (local address 127.22.4.194:40031)
0811 07:32:15.360410 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.360418 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.360441 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:32:15.360620 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.360624 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.360709 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.360815 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:15.361221 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.362000 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.363444 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.364091 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.364248 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.364340 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.364591 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.364696 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:32:15.364836 24224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.360092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:40031 (local address 127.22.4.195:51237)
0811 07:32:15.360246 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:15.360265 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:15.360409 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:15.360864 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:15.360867 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:15.360889 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:15.361044 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.361051 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.362144 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.362149 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.363288 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.363298 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.364251 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.364255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.364410 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.364449 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:32:15.364544 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:32:15.364636 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 07:32:15.365775 24252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.360092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36119 (local address 127.22.4.195:44277)
0811 07:32:15.361092 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:15.361156 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:15.361300 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:15.361598 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:15.361601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:15.361629 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:15.361777 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.361783 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.362950 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.362953 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.364216 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:15.364227 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.365285 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.365289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:15.365401 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.365424 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:32:15.365527 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 07:32:15.365611 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":921,"mutex_wait_us":475,"thread_start_us":189,"threads_started":1}
I20260811 07:32:15.365836 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.360624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:44277 (local address 127.22.4.193:36119)
0811 07:32:15.360818 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.360824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.361294 (+ 470us) server_negotiation.cc:407] Connection header received
0811 07:32:15.361420 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.361422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.361469 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.361557 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:15.361952 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.362742 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.364441 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.365117 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.365241 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.365295 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.365564 (+ 269us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.365694 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:32:15.365801 23938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d5d005f43d40f3b378fa4f852930ac" candidate_uuid: "a45c2eba6d374bf38519979705438714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e62abbca40a4372a80e698923260782" is_pre_election: true
I20260811 07:32:15.366245 23938 raft_consensus.cc:2454] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a45c2eba6d374bf38519979705438714 in term 0.
I20260811 07:32:15.366665 23717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d5d005f43d40f3b378fa4f852930ac" candidate_uuid: "a45c2eba6d374bf38519979705438714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17599b7517e944b0ab6965eb6b4acb9d" is_pre_election: true
I20260811 07:32:15.367025 23717 raft_consensus.cc:2454] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a45c2eba6d374bf38519979705438714 in term 0.
I20260811 07:32:15.367165 24044 leader_election.cc:302] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e62abbca40a4372a80e698923260782, a45c2eba6d374bf38519979705438714; no voters:
I20260811 07:32:15.367564 24251 raft_consensus.cc:2781] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:15.367733 24251 raft_consensus.cc:482] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:15.367790 24251 raft_consensus.cc:3037] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:15.369349 24251 raft_consensus.cc:504] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.369879 24251 leader_election.cc:288] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [CANDIDATE]: Term 1 election: Requested vote from peers 17599b7517e944b0ab6965eb6b4acb9d (127.22.4.193:36119), 8e62abbca40a4372a80e698923260782 (127.22.4.194:40031)
I20260811 07:32:15.370458 23717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d5d005f43d40f3b378fa4f852930ac" candidate_uuid: "a45c2eba6d374bf38519979705438714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17599b7517e944b0ab6965eb6b4acb9d"
I20260811 07:32:15.370507 23938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31d5d005f43d40f3b378fa4f852930ac" candidate_uuid: "a45c2eba6d374bf38519979705438714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e62abbca40a4372a80e698923260782"
I20260811 07:32:15.370633 23938 raft_consensus.cc:3037] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:15.370633 23717 raft_consensus.cc:3037] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:15.372232 23717 raft_consensus.cc:2454] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a45c2eba6d374bf38519979705438714 in term 1.
I20260811 07:32:15.372232 23938 raft_consensus.cc:2454] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a45c2eba6d374bf38519979705438714 in term 1.
I20260811 07:32:15.372881 24041 leader_election.cc:302] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17599b7517e944b0ab6965eb6b4acb9d, a45c2eba6d374bf38519979705438714; no voters:
I20260811 07:32:15.373939 24251 raft_consensus.cc:2781] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:15.374369 24251 raft_consensus.cc:686] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [term 1 LEADER]: Becoming Leader. State: Replica: a45c2eba6d374bf38519979705438714, State: Running, Role: LEADER
I20260811 07:32:15.374966 24251 consensus_queue.cc:237] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } }
I20260811 07:32:15.379660 23460 catalog_manager.cc:5495] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714 reported cstate change: term changed from 0 to 1, leader changed from <none> to a45c2eba6d374bf38519979705438714 (127.22.4.195). New cstate: current_term: 1 leader_uuid: "a45c2eba6d374bf38519979705438714" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a45c2eba6d374bf38519979705438714" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "17599b7517e944b0ab6965eb6b4acb9d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e62abbca40a4372a80e698923260782" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 40031 } health_report { overall_health: UNKNOWN } } }
W20260811 07:32:15.397925 23792 tablet.cc:2369] T 31d5d005f43d40f3b378fa4f852930ac P 17599b7517e944b0ab6965eb6b4acb9d: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[23391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433533, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:15.411955 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.398926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51238 (local address 127.22.4.193:36119)
0811 07:32:15.399179 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.399185 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.399369 (+ 184us) server_negotiation.cc:407] Connection header received
0811 07:32:15.399576 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.399580 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.399644 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.399753 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:15.400585 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.401181 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.402158 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.402397 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.402518 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.406551 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:15.406569 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:15.406594 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:15.406656 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:15.409529 (+ 2873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.410181 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.410188 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.410189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.410303 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.410693 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.410698 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.410699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.411107 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:15.411350 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.411605 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.411760 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260811 07:32:15.422189 24012 tablet.cc:2369] T 31d5d005f43d40f3b378fa4f852930ac P 8e62abbca40a4372a80e698923260782: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[23391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433535, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[23391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433535, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:15.454154 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.441218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51244 (local address 127.22.4.193:36119)
0811 07:32:15.441500 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.441505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.441572 (+ 67us) server_negotiation.cc:407] Connection header received
0811 07:32:15.442113 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.442117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.442178 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.442283 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:15.443514 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.444084 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.445326 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.445636 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.445756 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.449344 (+ 3588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:15.449349 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:15.449352 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:15.449404 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:15.451594 (+ 2190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.452295 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.452298 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.452300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.452480 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.452874 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.452877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.452879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.453148 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:15.453291 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.453796 (+ 505us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.453975 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
W20260811 07:32:15.469609 24223 tablet.cc:2369] T 31d5d005f43d40f3b378fa4f852930ac P a45c2eba6d374bf38519979705438714: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[23391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[23391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433535, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:15.492198 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:15.480035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51258 (local address 127.22.4.193:36119)
0811 07:32:15.480301 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:15.480307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:15.480486 (+ 179us) server_negotiation.cc:407] Connection header received
0811 07:32:15.480735 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:15.480738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:15.480799 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:15.480910 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:15.481929 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.482549 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.483664 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:15.483923 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:15.484056 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:15.487610 (+ 3554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:15.487615 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:15.487618 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:15.487660 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:15.489496 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.490123 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.490126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.490127 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.490228 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:15.490648 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:15.490651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:15.490652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:15.491145 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:15.491326 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:15.491783 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 07:32:15.491935 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127}
W20260811 07:32:15.494427 23649 tablet_service.cc:2908] Rejecting scan request for tablet 31d5d005f43d40f3b378fa4f852930ac: Uninitialized: clean time has not yet been initialized
I20260811 07:32:15.497742 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23578
I20260811 07:32:15.513079 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23796
I20260811 07:32:15.536015 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24016
I20260811 07:32:15.548695 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23407
2026-08-11T07:32:15Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (3077 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[24285](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[24285](info): set up 2 sockets
Aug 11 07:32:15 dist-test-slave-7z32 krb5kdc[24285](info): commencing operation
krb5kdc: starting...
W20260811 07:32:16.904732 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.322s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:17 dist-test-slave-7z32 krb5kdc[24285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:17.079815 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:35439
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:42307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:35439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:17.224026 24305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:17.224377 24305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:17.224422 24305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:17.228780 24305 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:17.228873 24305 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:32:17.228892 24305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:17.228911 24305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:17.228930 24305 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:17.228947 24305 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:17.235319 24305 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:42307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:35439
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:35439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:17.236747 24305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:17.238023 24305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:17.248772 24311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:17.248754 24315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:17.248756 24312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:17.249356 24305 server_base.cc:1034] running on GCE node
I20260811 07:32:17.250065 24305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:17.251472 24305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:17.254952 24305 hybrid_clock.cc:648] HybridClock initialized: now 1786433537254838 us; error 82 us; skew 500 ppm
Aug 11 07:32:17 dist-test-slave-7z32 krb5kdc[24285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433537, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:17.259531 24305 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:17.261042 24305 webserver.cc:460] Webserver started at http://127.22.4.254:36429/ using document root <none> and password file <none>
I20260811 07:32:17.261919 24305 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:17.262041 24305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:17.262362 24305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:17.265256 24305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "cbb6313621a0f6f6b99318b4dd75f4b3"
server_key_iv: "158aa32e7348af10217565d3b3f11b38"
server_key_version: "encryptionkey@0"
I20260811 07:32:17.266019 24305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "cbb6313621a0f6f6b99318b4dd75f4b3"
server_key_iv: "158aa32e7348af10217565d3b3f11b38"
server_key_version: "encryptionkey@0"
I20260811 07:32:17.271757 24305 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:32:17.276074 24325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:17.278601 24305 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:32:17.278928 24305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "cbb6313621a0f6f6b99318b4dd75f4b3"
server_key_iv: "158aa32e7348af10217565d3b3f11b38"
server_key_version: "encryptionkey@0"
I20260811 07:32:17.279156 24305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:17.313227 24305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:17.318425 24305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:17.318758 24305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:17.333235 24305 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:35439
I20260811 07:32:17.333269 24415 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:35439 every 8 connection(s)
I20260811 07:32:17.334923 24305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:17.339164 24416 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:17.342618 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24305
I20260811 07:32:17.342950 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:17.343444 22547 external_mini_cluster.cc:1428] Setting key e19c1b1c0b8adcdc93b9329ef75fde99
I20260811 07:32:17.347270 24416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf: Bootstrap starting.
I20260811 07:32:17.350530 24416 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:17.351565 24416 log.cc:824] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:17.354801 24416 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf: No bootstrap required, opened a new log
Aug 11 07:32:17 dist-test-slave-7z32 krb5kdc[24285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:17.359688 24416 raft_consensus.cc:348] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35439 } }
I20260811 07:32:17.360033 24416 raft_consensus.cc:374] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:17.360074 24416 raft_consensus.cc:729] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f59781d1d0ad461eb4a9c65f59a6f5cf, State: Initialized, Role: FOLLOWER
I20260811 07:32:17.360699 24416 consensus_queue.cc:260] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35439 } }
I20260811 07:32:17.360920 24416 raft_consensus.cc:388] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:17.361043 24416 raft_consensus.cc:482] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:17.361196 24416 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:17.362362 24416 raft_consensus.cc:504] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35439 } }
I20260811 07:32:17.362803 24416 leader_election.cc:302] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f59781d1d0ad461eb4a9c65f59a6f5cf; no voters:
I20260811 07:32:17.363335 24416 leader_election.cc:288] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:17.363437 24425 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:17.363648 24425 raft_consensus.cc:686] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [term 1 LEADER]: Becoming Leader. State: Replica: f59781d1d0ad461eb4a9c65f59a6f5cf, State: Running, Role: LEADER
I20260811 07:32:17.363996 24425 consensus_queue.cc:237] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35439 } }
I20260811 07:32:17.364933 24416 sys_catalog.cc:564] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:17.366303 24426 sys_catalog.cc:455] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35439 } } }
I20260811 07:32:17.367058 24426 sys_catalog.cc:458] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:17.366883 24428 sys_catalog.cc:455] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader f59781d1d0ad461eb4a9c65f59a6f5cf. Latest consensus state: current_term: 1 leader_uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f59781d1d0ad461eb4a9c65f59a6f5cf" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35439 } } }
I20260811 07:32:17.367599 24428 sys_catalog.cc:458] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:17.368147 24448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:17.369451 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:17.346075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35580 (local address 127.22.4.254:35439)
0811 07:32:17.346797 (+ 722us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:17.346880 (+ 83us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:17.346945 (+ 65us) server_negotiation.cc:407] Connection header received
0811 07:32:17.348013 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:17.348043 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:17.348611 (+ 568us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:17.349067 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:17.350406 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.352298 (+ 1892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.353977 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.354764 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.355164 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:17.359067 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:17.359076 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:17.359105 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:17.359159 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:17.362295 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:17.363288 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:17.363299 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:17.363309 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:17.363577 (+ 268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:17.364007 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:17.364012 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:17.364014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:17.365001 (+ 987us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:17.366703 (+ 1702us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:17.367059 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:32:17.367671 (+ 612us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":243,"threads_started":1}
I20260811 07:32:17.373781 24448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:17.381971 24448 catalog_manager.cc:1347] Generated new cluster ID: b1fc271221a248c489f3b5a3a72e7416
I20260811 07:32:17.382164 24448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:17.412232 24448 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:17.414121 24448 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:17.423791 24448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf: Generated new TSK 0
I20260811 07:32:17.425101 24448 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:17.476128 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35439
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:42307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:17.630987 24461 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:17.631469 24461 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:17.631543 24461 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:17.636740 24461 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:17.636852 24461 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:17.636905 24461 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:17.636945 24461 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:17.644894 24461 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:42307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:35439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24461
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:17.646929 24461 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:17.648516 24461 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:32:17.662684 24461 server_base.cc:1034] running on GCE node
W20260811 07:32:17.662552 24469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:17.662573 24468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:17.662730 24473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:17.663599 24461 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:17.664542 24461 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:17.665953 24461 hybrid_clock.cc:648] HybridClock initialized: now 1786433537665898 us; error 76 us; skew 500 ppm
Aug 11 07:32:17 dist-test-slave-7z32 krb5kdc[24285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433537, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:17.670715 24461 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:17.672343 24461 webserver.cc:460] Webserver started at http://127.22.4.193:46169/ using document root <none> and password file <none>
I20260811 07:32:17.673210 24461 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:17.673332 24461 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:17.673655 24461 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:17.676862 24461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "704b5ab85d9b2a6dd52be40a074925b4"
server_key_iv: "e17f0e7a7a84b6f6d035eebc42074eaa"
server_key_version: "encryptionkey@0"
I20260811 07:32:17.677982 24461 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "704b5ab85d9b2a6dd52be40a074925b4"
server_key_iv: "e17f0e7a7a84b6f6d035eebc42074eaa"
server_key_version: "encryptionkey@0"
I20260811 07:32:17.685194 24461 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260811 07:32:17.689479 24482 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:17.691974 24461 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 07:32:17.692245 24461 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "704b5ab85d9b2a6dd52be40a074925b4"
server_key_iv: "e17f0e7a7a84b6f6d035eebc42074eaa"
server_key_version: "encryptionkey@0"
I20260811 07:32:17.692456 24461 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:17.719910 24461 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:17.724988 24461 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:17.725353 24461 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:17.727778 24461 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:17.727870 24461 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:17.727936 24461 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:17.727959 24461 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:32:17 dist-test-slave-7z32 krb5kdc[24285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433537, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:17.745885 24461 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:36251
I20260811 07:32:17.745968 24678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:36251 every 8 connection(s)
I20260811 07:32:17.747715 24461 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:17.747977 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:17.729157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:48129 (local address 127.22.4.254:35439)
0811 07:32:17.729417 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:17.729425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:17.730771 (+ 1346us) server_negotiation.cc:407] Connection header received
0811 07:32:17.732801 (+ 2030us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:17.732805 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:17.732883 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:17.733068 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:17.735790 (+ 2722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.736455 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.737934 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.738199 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.738351 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:17.742404 (+ 4053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:17.742409 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:17.742411 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:17.742442 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:17.744568 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:17.745395 (+ 827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:17.745401 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:17.745404 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:17.745560 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:17.746122 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:17.746126 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:17.746128 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:17.746399 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:17.746499 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:17.747597 (+ 1098us) server_negotiation.cc:299] Negotiation successful
0811 07:32:17.747751 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:32:17.749385 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24461
I20260811 07:32:17.749570 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:17.749846 24497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:17.729678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35439 (local address 127.22.4.193:48129)
0811 07:32:17.730470 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:17.730570 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:17.732388 (+ 1818us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:17.733533 (+ 1145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:17.733553 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:17.734386 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:17.735477 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:17.735513 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.736676 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.736682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:17.737752 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:17.737768 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.738429 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.738433 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:17.738658 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:17.739499 (+ 841us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:17.739524 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:17.742154 (+ 2630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:17.744776 (+ 2622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:17.744785 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:17.744819 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:17.745233 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:17.745702 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:17.745706 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:17.745708 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:17.745973 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:17.746575 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:17.746586 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:17.747145 (+ 559us) client_negotiation.cc:769] Sending connection context
0811 07:32:17.747475 (+ 330us) client_negotiation.cc:240] Negotiation successful
0811 07:32:17.747999 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":168,"threads_started":1}
I20260811 07:32:17.750205 22547 external_mini_cluster.cc:1428] Setting key 5a61709277b10047ff01ce202d630f9e
I20260811 07:32:17.752486 24679 heartbeater.cc:347] Connected to a master server at 127.22.4.254:35439
I20260811 07:32:17.752807 24679 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:17.754066 24679 heartbeater.cc:511] Master 127.22.4.254:35439 requested a full tablet report, sending...
I20260811 07:32:17.756575 24350 ts_manager.cc:194] Registered new tserver with Master: c5f8fd0939f54cc8b2ac7479d58f1f02 (127.22.4.193:36251)
I20260811 07:32:17.758617 24350 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:48129
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:32:17.772780 24687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:17.757400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35439 (local address 127.22.4.193:55845)
0811 07:32:17.758282 (+ 882us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:17.758306 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:17.758494 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:17.759247 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:17.759252 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:17.759682 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:17.759883 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:17.759896 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.761325 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.761330 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:17.762424 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:17.762446 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.763317 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.763321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:17.763456 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:17.764202 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:17.764224 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:17.765084 (+ 860us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:17.768076 (+ 2992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:17.768083 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:17.768085 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:17.768621 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:17.770286 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:17.770472 (+ 186us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:17.770475 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:17.770725 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:17.771958 (+ 1233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:17.771961 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:17.772107 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 07:32:17.772228 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 07:32:17.772418 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":578,"threads_started":1}
I20260811 07:32:17.773880 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:17.757475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:55845 (local address 127.22.4.254:35439)
0811 07:32:17.757715 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:17.757721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:17.758450 (+ 729us) server_negotiation.cc:407] Connection header received
0811 07:32:17.758628 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:17.758634 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:17.758699 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:17.759050 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:17.760110 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.761102 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.762662 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:17.763108 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:17.763283 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:17.765387 (+ 2104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:17.765391 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:17.765393 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:17.765436 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:17.767794 (+ 2358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:17.768924 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:17.768929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:17.768931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:17.769095 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:17.771111 (+ 2016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:17.771119 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:17.771124 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:17.771567 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:17.771754 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:17.772399 (+ 645us) server_negotiation.cc:299] Negotiation successful
0811 07:32:17.773699 (+ 1300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:17.807250 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35439
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:42307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:17.950546 24691 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:17.950999 24691 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:17.951061 24691 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:17.956688 24691 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:17.956825 24691 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:17.956957 24691 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:17.957046 24691 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:17.963531 24691 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:42307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:35439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24691
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:17.965139 24691 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:17.966758 24691 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:17.980072 24698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:17.980129 24701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:17.980330 24691 server_base.cc:1034] running on GCE node
W20260811 07:32:17.980072 24699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:17.981222 24691 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:17.982482 24691 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:17.983721 24691 hybrid_clock.cc:648] HybridClock initialized: now 1786433537983703 us; error 95 us; skew 500 ppm
Aug 11 07:32:17 dist-test-slave-7z32 krb5kdc[24285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433537, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:17.988265 24691 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:17.989801 24691 webserver.cc:460] Webserver started at http://127.22.4.194:41809/ using document root <none> and password file <none>
I20260811 07:32:17.990814 24691 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:17.991008 24691 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:17.991307 24691 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:17.994341 24691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "1920ed7e70914472af467d891c7cce2e"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "eed50ddea1838ec4aa2083ad6f05738a"
server_key_iv: "ce5f62528600ef1e99b7917b0fbc4825"
server_key_version: "encryptionkey@0"
I20260811 07:32:17.995266 24691 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "1920ed7e70914472af467d891c7cce2e"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "eed50ddea1838ec4aa2083ad6f05738a"
server_key_iv: "ce5f62528600ef1e99b7917b0fbc4825"
server_key_version: "encryptionkey@0"
I20260811 07:32:18.001252 24691 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 07:32:18.005395 24718 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:18.007500 24691 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 07:32:18.007740 24691 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "1920ed7e70914472af467d891c7cce2e"
format_stamp: "Formatted at 2026-08-11 07:32:17 on dist-test-slave-7z32"
server_key: "eed50ddea1838ec4aa2083ad6f05738a"
server_key_iv: "ce5f62528600ef1e99b7917b0fbc4825"
server_key_version: "encryptionkey@0"
I20260811 07:32:18.007922 24691 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:18.029585 24691 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:18.034802 24691 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:18.035183 24691 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:18.037433 24691 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:18.037497 24691 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:18.037547 24691 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:18.037618 24691 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:32:18 dist-test-slave-7z32 krb5kdc[24285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433537, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:18.053587 24691 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:36567
I20260811 07:32:18.053727 24892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:36567 every 8 connection(s)
I20260811 07:32:18.055471 24691 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:18.060004 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24691
I20260811 07:32:18.060194 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.039081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:40827 (local address 127.22.4.254:35439)
0811 07:32:18.039287 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.039295 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.040931 (+ 1636us) server_negotiation.cc:407] Connection header received
0811 07:32:18.042884 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.042889 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.042999 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.043116 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:18.046430 (+ 3314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.047897 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.049603 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.049853 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.049991 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.054087 (+ 4096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:18.054093 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:18.054097 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:18.054148 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:18.056626 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.057617 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.057621 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.057623 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.057790 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.058350 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.058352 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.058354 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.058599 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:18.058741 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.059732 (+ 991us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.059952 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 07:32:18.060213 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:18.060587 22547 external_mini_cluster.cc:1428] Setting key c4ff27f48ba9a4ee800aa987452f59a0
I20260811 07:32:18.061218 24736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.039761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35439 (local address 127.22.4.194:40827)
0811 07:32:18.040670 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.040747 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.042303 (+ 1556us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.043548 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.043566 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.044357 (+ 791us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:18.045674 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.045718 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.048133 (+ 2415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.048137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.049356 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.049405 (+ 49us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.050067 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.050072 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.050505 (+ 433us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.051503 (+ 998us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:18.051525 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:18.053694 (+ 2169us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:18.056843 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.056850 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.056956 (+ 106us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.057466 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.057995 (+ 529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.057998 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.058000 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.058211 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.058781 (+ 570us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:18.058788 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:18.059245 (+ 457us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.059525 (+ 280us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.059947 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":204,"threads_started":1}
I20260811 07:32:18.063308 24893 heartbeater.cc:347] Connected to a master server at 127.22.4.254:35439
I20260811 07:32:18.067217 24893 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:18.068163 24893 heartbeater.cc:511] Master 127.22.4.254:35439 requested a full tablet report, sending...
I20260811 07:32:18.069770 24352 ts_manager.cc:194] Registered new tserver with Master: 1920ed7e70914472af467d891c7cce2e (127.22.4.194:36567)
I20260811 07:32:18.070797 24352 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:40827
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:18.079097 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.067376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:37201 (local address 127.22.4.254:35439)
0811 07:32:18.067603 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.067608 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.067918 (+ 310us) server_negotiation.cc:407] Connection header received
0811 07:32:18.068105 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.068108 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.068173 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.068272 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:18.068915 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.069784 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.071346 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.071722 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.071903 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.073872 (+ 1969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:18.073878 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:18.073891 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:18.073940 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:18.075905 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.077087 (+ 1182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.077092 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.077093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.077257 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.077635 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.077639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.077641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.077966 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:18.078222 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.078670 (+ 448us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.078921 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260811 07:32:18.079185 24902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.067370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35439 (local address 127.22.4.194:37201)
0811 07:32:18.067813 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.067828 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.067981 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.068388 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.068391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.068638 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:18.068776 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.068782 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.069996 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.070003 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.071098 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.071118 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.071946 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.071953 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.072099 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.072967 (+ 868us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:18.072989 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:18.073600 (+ 611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:18.076130 (+ 2530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.076134 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.076137 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.076531 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.077383 (+ 852us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.077388 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.077390 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.077505 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.078195 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:18.078199 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:18.078381 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.078522 (+ 141us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.078777 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":137,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:18.104785 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35439
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:42307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:18.247502 24904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:18.247817 24904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:18.247865 24904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:18.252277 24904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:18.252369 24904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:18.252413 24904 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:18.252449 24904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:18.258713 24904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:42307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:35439
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:18.260129 24904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:18.261278 24904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:18.275576 24911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:18.275697 24914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:18.275700 24912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:18.276948 24904 server_base.cc:1034] running on GCE node
I20260811 07:32:18.277719 24904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:18.278558 24904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:18.282138 24904 hybrid_clock.cc:648] HybridClock initialized: now 1786433538282038 us; error 89 us; skew 500 ppm
Aug 11 07:32:18 dist-test-slave-7z32 krb5kdc[24285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433538, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:18.287520 24904 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:18.289218 24904 webserver.cc:460] Webserver started at http://127.22.4.195:34507/ using document root <none> and password file <none>
I20260811 07:32:18.290148 24904 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:18.290248 24904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:18.290588 24904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:18.293859 24904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "7bf61b2ba9f8420bb61ca0414fb84847"
format_stamp: "Formatted at 2026-08-11 07:32:18 on dist-test-slave-7z32"
server_key: "94d15e996a31854f28e4af9c11c215a8"
server_key_iv: "f3fb3b37548d9295140372a697271573"
server_key_version: "encryptionkey@0"
I20260811 07:32:18.294772 24904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "7bf61b2ba9f8420bb61ca0414fb84847"
format_stamp: "Formatted at 2026-08-11 07:32:18 on dist-test-slave-7z32"
server_key: "94d15e996a31854f28e4af9c11c215a8"
server_key_iv: "f3fb3b37548d9295140372a697271573"
server_key_version: "encryptionkey@0"
I20260811 07:32:18.301354 24904 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 07:32:18.305583 24927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:18.307828 24904 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:18.308070 24904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "7bf61b2ba9f8420bb61ca0414fb84847"
format_stamp: "Formatted at 2026-08-11 07:32:18 on dist-test-slave-7z32"
server_key: "94d15e996a31854f28e4af9c11c215a8"
server_key_iv: "f3fb3b37548d9295140372a697271573"
server_key_version: "encryptionkey@0"
I20260811 07:32:18.308320 24904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:18.323868 24904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:18.330101 24904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:18.330375 24904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:18.333422 24904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:18.333524 24904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:18.333593 24904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:18.333614 24904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:32:18 dist-test-slave-7z32 krb5kdc[24285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433538, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:18.348115 24904 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:38377
I20260811 07:32:18.349620 24904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:18.350163 25097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:38377 every 8 connection(s)
I20260811 07:32:18.353094 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.334510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:54807 (local address 127.22.4.254:35439)
0811 07:32:18.334684 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.334690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.336669 (+ 1979us) server_negotiation.cc:407] Connection header received
0811 07:32:18.338280 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.338287 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.338378 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.338452 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:18.341006 (+ 2554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.341987 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.344005 (+ 2018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.344281 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.344419 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.347937 (+ 3518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:18.347943 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:18.347947 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:18.347987 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:18.349785 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.350609 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.350617 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.350619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.350734 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.351352 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.351356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.351358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.351650 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:18.351750 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.352693 (+ 943us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.352907 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:32:18.354281 24938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.335761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35439 (local address 127.22.4.195:54807)
0811 07:32:18.336433 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.336515 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.337922 (+ 1407us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.339071 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.339085 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.339780 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:18.340730 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.340758 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.342229 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.342233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.343839 (+ 1606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.343853 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.344486 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.344491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.344704 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.345486 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:18.345506 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:18.347655 (+ 2149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:18.349962 (+ 2307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.349972 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.349993 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.350426 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.351004 (+ 578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.351008 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.351010 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.351212 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.351828 (+ 616us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:18.351838 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:18.352282 (+ 444us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.352581 (+ 299us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.353148 (+ 567us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":219,"threads_started":1}
I20260811 07:32:18.356086 25101 heartbeater.cc:347] Connected to a master server at 127.22.4.254:35439
I20260811 07:32:18.356389 25101 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:18.357213 25101 heartbeater.cc:511] Master 127.22.4.254:35439 requested a full tablet report, sending...
I20260811 07:32:18.357511 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24904
I20260811 07:32:18.357663 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:18.357986 22547 external_mini_cluster.cc:1428] Setting key befb74b3401baf6502ce85b63be83f82
I20260811 07:32:18.359105 24351 ts_manager.cc:194] Registered new tserver with Master: 7bf61b2ba9f8420bb61ca0414fb84847 (127.22.4.195:38377)
I20260811 07:32:18.360105 24351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:54807
I20260811 07:32:18.360960 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:32:18.370795 25113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.359506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35439 (local address 127.22.4.195:45845)
0811 07:32:18.360619 (+ 1113us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.360640 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.360775 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.361205 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.361208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.361541 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:18.361840 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.361854 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.362980 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.362987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.364053 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.364070 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.364773 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.364779 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.364920 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.365609 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:18.365631 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:18.366319 (+ 688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:18.368758 (+ 2439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.368763 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.368766 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.369059 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.369419 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.369422 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.369425 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.369539 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.370125 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:18.370128 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:18.370255 (+ 127us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.370378 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.370595 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":962,"mutex_wait_us":3,"thread_start_us":177,"threads_started":1}
I20260811 07:32:18.370776 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.359340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:45845 (local address 127.22.4.254:35439)
0811 07:32:18.359530 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.359534 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.360715 (+ 1181us) server_negotiation.cc:407] Connection header received
0811 07:32:18.360922 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.360925 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.360988 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.361160 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:18.362006 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.362753 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.364246 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.364585 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.364729 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.366597 (+ 1868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:18.366601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:18.366603 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:18.366631 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:18.368582 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.369196 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.369200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.369202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.369304 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.369653 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.369657 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.369659 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.369895 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:18.370133 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.370444 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.370590 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 07:32:18 dist-test-slave-7z32 krb5kdc[24285](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433538, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:32:18 dist-test-slave-7z32 krb5kdc[24285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433538, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:18.400463 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.389585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35590 (local address 127.22.4.254:35439)
0811 07:32:18.389783 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.389788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.389863 (+ 75us) server_negotiation.cc:407] Connection header received
0811 07:32:18.390178 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.390182 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.390249 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.390342 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:18.391368 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.392036 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.393053 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.393286 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.393392 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.396766 (+ 3374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:18.396770 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:18.396772 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:18.396811 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:18.398511 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.399094 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.399098 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.399100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.399189 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.399509 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.399513 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.399515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.399723 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:18.399875 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.400158 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.400284 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:32:18.404367 24352 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:18.408190 24352 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:18.429525 25128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.423003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:38377 (local address 127.0.0.1:42914)
0811 07:32:18.423479 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.423545 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.423719 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.425051 (+ 1332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.425058 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.425086 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.425276 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.425284 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.426702 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.426708 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.427929 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.427940 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.428850 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.428854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.428979 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.429025 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.429154 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.429333 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":64,"spinlock_wait_cycles":10880,"thread_start_us":164,"threads_started":1}
I20260811 07:32:18.429836 25129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.423091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36251 (local address 127.0.0.1:47178)
0811 07:32:18.423480 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.423546 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.423720 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.425326 (+ 1606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.425329 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.425348 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.425474 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.425481 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.426870 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.426874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.428151 (+ 1277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.428161 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.429391 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.429395 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.429489 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.429525 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.429615 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.429703 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"mutex_wait_us":7,"spinlock_wait_cycles":16000,"thread_start_us":155,"threads_started":1}
I20260811 07:32:18.429981 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.424182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47178 (local address 127.22.4.193:36251)
0811 07:32:18.424525 (+ 343us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.424532 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.424555 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:32:18.424675 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.424684 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.424952 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.425134 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.425621 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.426723 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.428305 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.429202 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.429300 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.429478 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.429679 (+ 201us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.429814 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":129,"threads_started":1}
I20260811 07:32:18.430550 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.423981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42914 (local address 127.22.4.195:38377)
0811 07:32:18.424443 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.424457 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.424485 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:32:18.424573 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.424580 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.424845 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.425485 (+ 640us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.425638 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.426582 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.428076 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.428693 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.428841 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.429038 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.430249 (+ 1211us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.430376 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":142,"threads_started":1}
I20260811 07:32:18.434101 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.424821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36567 (local address 127.0.0.1:45798)
0811 07:32:18.425197 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.425212 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.425503 (+ 291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.427779 (+ 2276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.427782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.427801 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.427910 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.427915 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.429354 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.429358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.432250 (+ 2892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.432264 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.433572 (+ 1308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.433576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.433697 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.433732 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.433811 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.433906 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":127,"threads_started":1}
I20260811 07:32:18.433862 24571 tablet_service.cc:1467] Processing CreateTablet for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 (DEFAULT_TABLE table=test-table [id=1e2aed5a40f74c34b359abc6752ce52c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:18.433943 25007 tablet_service.cc:1467] Processing CreateTablet for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 (DEFAULT_TABLE table=test-table [id=1e2aed5a40f74c34b359abc6752ce52c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:18.434918 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.425040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45798 (local address 127.22.4.194:36567)
0811 07:32:18.427104 (+ 2064us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.427118 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.427146 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:32:18.427230 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.427236 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.427442 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.427614 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.428032 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.429219 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.432450 (+ 3231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.433375 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.433535 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.434520 (+ 985us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.434595 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.434710 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1933,"thread_start_us":170,"threads_started":1}
I20260811 07:32:18.435339 24571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.435873 25007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.439051 24792 tablet_service.cc:1467] Processing CreateTablet for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 (DEFAULT_TABLE table=test-table [id=1e2aed5a40f74c34b359abc6752ce52c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:18.441103 24792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.443517 25140 tablet_bootstrap.cc:492] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Bootstrap starting.
I20260811 07:32:18.446063 25140 tablet_bootstrap.cc:654] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.447364 25141 tablet_bootstrap.cc:492] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: Bootstrap starting.
I20260811 07:32:18.447518 25140 log.cc:824] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:18.449667 25140 tablet_bootstrap.cc:492] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: No bootstrap required, opened a new log
I20260811 07:32:18.449924 25140 ts_tablet_manager.cc:1397] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 07:32:18.450402 25141 tablet_bootstrap.cc:654] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.451520 25141 log.cc:824] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:18.451738 25143 tablet_bootstrap.cc:492] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Bootstrap starting.
I20260811 07:32:18.454854 25143 tablet_bootstrap.cc:654] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.455111 25141 tablet_bootstrap.cc:492] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: No bootstrap required, opened a new log
I20260811 07:32:18.454931 25140 raft_consensus.cc:348] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.455259 25140 raft_consensus.cc:374] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.455339 25140 raft_consensus.cc:729] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f8fd0939f54cc8b2ac7479d58f1f02, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.455387 25141 ts_tablet_manager.cc:1397] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:32:18.455866 25143 log.cc:824] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:18.455857 25140 consensus_queue.cc:260] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.457047 25140 ts_tablet_manager.cc:1428] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:32:18.457576 24679 heartbeater.cc:503] Master 127.22.4.254:35439 was elected leader, sending a full tablet report...
I20260811 07:32:18.458571 25143 tablet_bootstrap.cc:492] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: No bootstrap required, opened a new log
I20260811 07:32:18.458889 25143 ts_tablet_manager.cc:1397] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 07:32:18.460134 25141 raft_consensus.cc:348] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.460404 25141 raft_consensus.cc:374] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.460449 25141 raft_consensus.cc:729] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf61b2ba9f8420bb61ca0414fb84847, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.460945 25141 consensus_queue.cc:260] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.461920 25101 heartbeater.cc:503] Master 127.22.4.254:35439 was elected leader, sending a full tablet report...
I20260811 07:32:18.462208 25141 ts_tablet_manager.cc:1428] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 07:32:18.463228 25143 raft_consensus.cc:348] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.463670 25143 raft_consensus.cc:374] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.463742 25143 raft_consensus.cc:729] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1920ed7e70914472af467d891c7cce2e, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.464318 25143 consensus_queue.cc:260] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.465332 24893 heartbeater.cc:503] Master 127.22.4.254:35439 was elected leader, sending a full tablet report...
I20260811 07:32:18.465770 25143 ts_tablet_manager.cc:1428] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20260811 07:32:18.499691 24680 tablet.cc:2369] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:18.515085 25146 raft_consensus.cc:482] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:18.515329 25146 raft_consensus.cc:504] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.516752 25146 leader_election.cc:288] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7bf61b2ba9f8420bb61ca0414fb84847 (127.22.4.195:38377), 1920ed7e70914472af467d891c7cce2e (127.22.4.194:36567)
I20260811 07:32:18.524343 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.517437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:58539 (local address 127.22.4.195:38377)
0811 07:32:18.517592 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.517597 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.518208 (+ 611us) server_negotiation.cc:407] Connection header received
0811 07:32:18.518417 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.518421 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.518483 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.518600 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.519322 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.520216 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.522573 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.523360 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.523540 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.523615 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.524056 (+ 441us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.524166 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:32:18.524348 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.517491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:34891 (local address 127.22.4.194:36567)
0811 07:32:18.517672 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.517680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.518203 (+ 523us) server_negotiation.cc:407] Connection header received
0811 07:32:18.518400 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.518404 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.518483 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.518600 (+ 117us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.519322 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.520240 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.522573 (+ 2333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.523354 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.523540 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.523615 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.524071 (+ 456us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.524166 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:32:18.524351 25153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.517341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36567 (local address 127.22.4.193:34891)
0811 07:32:18.518051 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.518067 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.518220 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.518707 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.518711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.518746 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.519115 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.519125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.520403 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.520408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.522341 (+ 1933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.522356 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.523565 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.523570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.523794 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.523857 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.523968 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.524111 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":649,"mutex_wait_us":476,"spinlock_wait_cycles":33280,"thread_start_us":275,"threads_started":1}
I20260811 07:32:18.524818 25152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.517318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:38377 (local address 127.22.4.193:58539)
0811 07:32:18.518005 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.518024 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.518220 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.518706 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.518711 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.518746 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.519115 (+ 369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.519125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.520439 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.520445 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.522340 (+ 1895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.522356 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.523565 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.523570 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.523751 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.523851 (+ 100us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.523986 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.524109 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":333,"spinlock_wait_cycles":25600,"thread_start_us":334,"threads_started":1}
I20260811 07:32:18.525359 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ed8ae79e8bf4cc6bd2b4e88956d1548" candidate_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1920ed7e70914472af467d891c7cce2e" is_pre_election: true
I20260811 07:32:18.525866 24825 raft_consensus.cc:2454] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f8fd0939f54cc8b2ac7479d58f1f02 in term 0.
I20260811 07:32:18.526150 25036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ed8ae79e8bf4cc6bd2b4e88956d1548" candidate_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" is_pre_election: true
I20260811 07:32:18.526616 25036 raft_consensus.cc:2454] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c5f8fd0939f54cc8b2ac7479d58f1f02 in term 0.
I20260811 07:32:18.526672 24488 leader_election.cc:302] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1920ed7e70914472af467d891c7cce2e, c5f8fd0939f54cc8b2ac7479d58f1f02; no voters:
I20260811 07:32:18.527102 25146 raft_consensus.cc:2781] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:18.527264 25146 raft_consensus.cc:482] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:18.527333 25146 raft_consensus.cc:3037] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.528880 25146 raft_consensus.cc:504] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.529471 25146 leader_election.cc:288] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [CANDIDATE]: Term 1 election: Requested vote from peers 7bf61b2ba9f8420bb61ca0414fb84847 (127.22.4.195:38377), 1920ed7e70914472af467d891c7cce2e (127.22.4.194:36567)
I20260811 07:32:18.530340 25036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ed8ae79e8bf4cc6bd2b4e88956d1548" candidate_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf61b2ba9f8420bb61ca0414fb84847"
I20260811 07:32:18.530341 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ed8ae79e8bf4cc6bd2b4e88956d1548" candidate_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1920ed7e70914472af467d891c7cce2e"
I20260811 07:32:18.530566 25036 raft_consensus.cc:3037] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.530567 24825 raft_consensus.cc:3037] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.532461 24825 raft_consensus.cc:2454] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f8fd0939f54cc8b2ac7479d58f1f02 in term 1.
I20260811 07:32:18.532943 25036 raft_consensus.cc:2454] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c5f8fd0939f54cc8b2ac7479d58f1f02 in term 1.
I20260811 07:32:18.533265 24488 leader_election.cc:302] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1920ed7e70914472af467d891c7cce2e, c5f8fd0939f54cc8b2ac7479d58f1f02; no voters:
I20260811 07:32:18.533618 25146 raft_consensus.cc:2781] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:18.533979 25146 raft_consensus.cc:686] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 LEADER]: Becoming Leader. State: Replica: c5f8fd0939f54cc8b2ac7479d58f1f02, State: Running, Role: LEADER
I20260811 07:32:18.534444 25146 consensus_queue.cc:237] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } }
I20260811 07:32:18.539450 24351 catalog_manager.cc:5495] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 reported cstate change: term changed from 0 to 1, leader changed from <none> to c5f8fd0939f54cc8b2ac7479d58f1f02 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } health_report { overall_health: UNKNOWN } } }
W20260811 07:32:18.557307 24895 tablet.cc:2369] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:18.570878 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.565790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42774 (local address 127.22.4.193:36251)
0811 07:32:18.565987 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.565991 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.566015 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:32:18.566195 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.566198 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.566280 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.566511 (+ 231us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:18.567153 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.567707 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.568740 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.568985 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.569114 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.569576 (+ 462us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:18.570239 (+ 663us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:18.570391 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.570527 (+ 136us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.570614 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:32:18.579438 25036 raft_consensus.cc:1261] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Refusing update from remote peer c5f8fd0939f54cc8b2ac7479d58f1f02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:18.579758 24825 raft_consensus.cc:1261] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Refusing update from remote peer c5f8fd0939f54cc8b2ac7479d58f1f02: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:18.580549 25154 consensus_queue.cc:1035] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:18.580821 25146 consensus_queue.cc:1035] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:18.609241 24350 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:18.609615 24350 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:18.613924 24350 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf: Sending DeleteTablet for 3 replicas of tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548
I20260811 07:32:18.615379 24571 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:18 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:47178
I20260811 07:32:18.615520 24792 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:18 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:45798
I20260811 07:32:18.615837 25007 tablet_service.cc:1514] Processing DeleteTablet for tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:18 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:42914
I20260811 07:32:18.616287 25171 tablet_replica.cc:330] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: stopping tablet replica
I20260811 07:32:18.616580 25172 tablet_replica.cc:330] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: stopping tablet replica
I20260811 07:32:18.616797 25171 raft_consensus.cc:2229] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:18.617055 25170 tablet_replica.cc:330] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: stopping tablet replica
I20260811 07:32:18.617312 25171 raft_consensus.cc:2258] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:18.617547 25170 raft_consensus.cc:2229] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:18.617476 24350 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:32:18.618059 25172 raft_consensus.cc:2229] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 07:32:18.618141 24350 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:18.618301 25170 raft_consensus.cc:2258] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:18.620261 25171 ts_tablet_manager.cc:1905] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:18.620289 25170 ts_tablet_manager.cc:1905] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:18.624006 25170 ts_tablet_manager.cc:1918] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:18.624157 25171 ts_tablet_manager.cc:1918] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:18.624315 25171 log.cc:1196] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/3ed8ae79e8bf4cc6bd2b4e88956d1548
I20260811 07:32:18.624243 25170 log.cc:1196] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/3ed8ae79e8bf4cc6bd2b4e88956d1548
I20260811 07:32:18.624759 25171 ts_tablet_manager.cc:1939] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 1920ed7e70914472af467d891c7cce2e: Deleting consensus metadata
I20260811 07:32:18.624954 25170 ts_tablet_manager.cc:1939] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P c5f8fd0939f54cc8b2ac7479d58f1f02: Deleting consensus metadata
I20260811 07:32:18.626999 25172 raft_consensus.cc:2258] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:18.626964 24571 tablet_service.cc:1467] Processing CreateTablet for tablet 9737734d9ff8435fbe68e43fb2893a5b (DEFAULT_TABLE table=test-table [id=d91fb50a83e848b1bbf03b1a270ea79a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:18.627374 24571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9737734d9ff8435fbe68e43fb2893a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.628122 25007 tablet_service.cc:1467] Processing CreateTablet for tablet 9737734d9ff8435fbe68e43fb2893a5b (DEFAULT_TABLE table=test-table [id=d91fb50a83e848b1bbf03b1a270ea79a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:18.628502 25007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9737734d9ff8435fbe68e43fb2893a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.629756 25172 ts_tablet_manager.cc:1905] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:18.631006 25140 tablet_bootstrap.cc:492] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: Bootstrap starting.
I20260811 07:32:18.632221 25141 tablet_bootstrap.cc:492] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: Bootstrap starting.
I20260811 07:32:18.632457 25140 tablet_bootstrap.cc:654] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.633235 24331 catalog_manager.cc:4841] TS 1920ed7e70914472af467d891c7cce2e (127.22.4.194:36567): tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 (table test-table [id=1e2aed5a40f74c34b359abc6752ce52c]) successfully deleted
I20260811 07:32:18.633394 24329 catalog_manager.cc:4841] TS c5f8fd0939f54cc8b2ac7479d58f1f02 (127.22.4.193:36251): tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 (table test-table [id=1e2aed5a40f74c34b359abc6752ce52c]) successfully deleted
I20260811 07:32:18.633522 25141 tablet_bootstrap.cc:654] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.634202 24792 tablet_service.cc:1467] Processing CreateTablet for tablet 9737734d9ff8435fbe68e43fb2893a5b (DEFAULT_TABLE table=test-table [id=d91fb50a83e848b1bbf03b1a270ea79a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:18.634671 24792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9737734d9ff8435fbe68e43fb2893a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.635749 25172 ts_tablet_manager.cc:1918] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:18.635814 25140 tablet_bootstrap.cc:492] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: No bootstrap required, opened a new log
I20260811 07:32:18.635900 25172 log.cc:1196] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/3ed8ae79e8bf4cc6bd2b4e88956d1548
I20260811 07:32:18.635912 25140 ts_tablet_manager.cc:1397] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260811 07:32:18.636328 25172 ts_tablet_manager.cc:1939] T 3ed8ae79e8bf4cc6bd2b4e88956d1548 P 7bf61b2ba9f8420bb61ca0414fb84847: Deleting consensus metadata
I20260811 07:32:18.636610 25140 raft_consensus.cc:348] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.636754 25140 raft_consensus.cc:374] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.636787 25140 raft_consensus.cc:729] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f8fd0939f54cc8b2ac7479d58f1f02, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.636938 25140 consensus_queue.cc:260] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.637202 25140 ts_tablet_manager.cc:1428] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:32:18.638144 25143 tablet_bootstrap.cc:492] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: Bootstrap starting.
I20260811 07:32:18.638157 24326 catalog_manager.cc:4841] TS 7bf61b2ba9f8420bb61ca0414fb84847 (127.22.4.195:38377): tablet 3ed8ae79e8bf4cc6bd2b4e88956d1548 (table test-table [id=1e2aed5a40f74c34b359abc6752ce52c]) successfully deleted
I20260811 07:32:18.639436 25143 tablet_bootstrap.cc:654] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.639775 25141 tablet_bootstrap.cc:492] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: No bootstrap required, opened a new log
I20260811 07:32:18.639879 25141 ts_tablet_manager.cc:1397] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 07:32:18.640415 25141 raft_consensus.cc:348] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.640627 25141 raft_consensus.cc:374] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.640667 25141 raft_consensus.cc:729] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf61b2ba9f8420bb61ca0414fb84847, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.640825 25141 consensus_queue.cc:260] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.641162 25141 ts_tablet_manager.cc:1428] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:32:18.641527 25143 tablet_bootstrap.cc:492] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: No bootstrap required, opened a new log
I20260811 07:32:18.641652 25143 ts_tablet_manager.cc:1397] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:18.642253 25143 raft_consensus.cc:348] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.642402 25143 raft_consensus.cc:374] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.642439 25143 raft_consensus.cc:729] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1920ed7e70914472af467d891c7cce2e, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.642643 25143 consensus_queue.cc:260] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.643559 25143 ts_tablet_manager.cc:1428] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:32:18.778630 25150 raft_consensus.cc:482] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:18.778900 25150 raft_consensus.cc:504] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.781546 25150 leader_election.cc:288] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f8fd0939f54cc8b2ac7479d58f1f02 (127.22.4.193:36251), 1920ed7e70914472af467d891c7cce2e (127.22.4.194:36567)
I20260811 07:32:18.787137 24938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.781998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36567 (local address 127.22.4.195:52639)
0811 07:32:18.782239 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.782263 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.782415 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.783102 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.783105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.783125 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.783291 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.783298 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.784442 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.784446 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.785527 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.785537 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.786565 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.786569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.786684 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.786718 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.786852 (+ 134us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.786964 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"spinlock_wait_cycles":1280}
I20260811 07:32:18.787276 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.782492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:52639 (local address 127.22.4.194:36567)
0811 07:32:18.782698 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.782703 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.782721 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:32:18.782783 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.782786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.782875 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.782964 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.783443 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.784301 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.785695 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.786381 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.786651 (+ 270us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.786736 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.786907 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.787012 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 07:32:18.788055 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9737734d9ff8435fbe68e43fb2893a5b" candidate_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1920ed7e70914472af467d891c7cce2e" is_pre_election: true
I20260811 07:32:18.788264 24825 raft_consensus.cc:2454] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf61b2ba9f8420bb61ca0414fb84847 in term 0.
I20260811 07:32:18.788594 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.782262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:42921 (local address 127.22.4.193:36251)
0811 07:32:18.782443 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.782448 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.783069 (+ 621us) server_negotiation.cc:407] Connection header received
0811 07:32:18.783383 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.783391 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.783439 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.783532 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.783925 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.784656 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.786437 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.787230 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.787381 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.787479 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.788262 (+ 783us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.788397 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:32:18.788827 24932 leader_election.cc:302] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1920ed7e70914472af467d891c7cce2e, 7bf61b2ba9f8420bb61ca0414fb84847; no voters:
I20260811 07:32:18.789306 25178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.782017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36251 (local address 127.22.4.195:42921)
0811 07:32:18.782935 (+ 918us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.782956 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.783208 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.783545 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.783548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.783565 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.783731 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.783746 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.784815 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.784820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.786173 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.786190 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.787818 (+ 1628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.787822 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.788045 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.788094 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.788882 (+ 788us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.789032 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":840,"mutex_wait_us":467,"spinlock_wait_cycles":35072,"thread_start_us":153,"threads_started":1}
I20260811 07:32:18.789397 25150 raft_consensus.cc:2781] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:18.789463 25150 raft_consensus.cc:482] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:18.789501 25150 raft_consensus.cc:3037] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.790066 24600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9737734d9ff8435fbe68e43fb2893a5b" candidate_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" is_pre_election: true
I20260811 07:32:18.790459 24600 raft_consensus.cc:2454] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7bf61b2ba9f8420bb61ca0414fb84847 in term 0.
I20260811 07:32:18.791321 25150 raft_consensus.cc:504] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.791884 25150 leader_election.cc:288] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [CANDIDATE]: Term 1 election: Requested vote from peers c5f8fd0939f54cc8b2ac7479d58f1f02 (127.22.4.193:36251), 1920ed7e70914472af467d891c7cce2e (127.22.4.194:36567)
I20260811 07:32:18.792469 24600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9737734d9ff8435fbe68e43fb2893a5b" candidate_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02"
I20260811 07:32:18.792546 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9737734d9ff8435fbe68e43fb2893a5b" candidate_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1920ed7e70914472af467d891c7cce2e"
I20260811 07:32:18.792676 24825 raft_consensus.cc:3037] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.792662 24600 raft_consensus.cc:3037] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.793857 24825 raft_consensus.cc:2454] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf61b2ba9f8420bb61ca0414fb84847 in term 1.
I20260811 07:32:18.794245 24600 raft_consensus.cc:2454] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7bf61b2ba9f8420bb61ca0414fb84847 in term 1.
I20260811 07:32:18.794292 24932 leader_election.cc:302] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1920ed7e70914472af467d891c7cce2e, 7bf61b2ba9f8420bb61ca0414fb84847; no voters:
I20260811 07:32:18.794636 25150 raft_consensus.cc:2781] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:18.795150 25150 raft_consensus.cc:686] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 LEADER]: Becoming Leader. State: Replica: 7bf61b2ba9f8420bb61ca0414fb84847, State: Running, Role: LEADER
I20260811 07:32:18.795476 25150 consensus_queue.cc:237] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.798983 24350 catalog_manager.cc:5495] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7bf61b2ba9f8420bb61ca0414fb84847 (127.22.4.195). New cstate: current_term: 1 leader_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } health_report { overall_health: HEALTHY } } }
W20260811 07:32:18.853138 25102 tablet.cc:2369] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 07:32:18 dist-test-slave-7z32 krb5kdc[24285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433537, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:18.864533 25187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.853356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35439 (local address 127.0.0.1:53012)
0811 07:32:18.853738 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.853757 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.854075 (+ 318us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.854425 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.854428 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.854974 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:18.855081 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.855089 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.855893 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.855899 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.856540 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.856550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.857079 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.857083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.857236 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.858455 (+ 1219us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:18.858469 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:18.860173 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:18.862177 (+ 2004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.862191 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.862203 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.862459 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.862759 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:18.862764 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:18.862766 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:18.862920 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:18.863672 (+ 752us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:18.863685 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:18.863915 (+ 230us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.864094 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.864319 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":40,"thread_start_us":166,"threads_started":1}
I20260811 07:32:18.864871 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.853384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53012 (local address 127.22.4.254:35439)
0811 07:32:18.853539 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.853547 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.853887 (+ 340us) server_negotiation.cc:407] Connection header received
0811 07:32:18.854234 (+ 347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.854238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.854293 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.854393 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:18.855232 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.855764 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.856717 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.856942 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.857062 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.860370 (+ 3308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:18.860374 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:18.860376 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:18.860399 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:18.862019 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.862571 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.862576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.862577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.862660 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:18.863036 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:18.863040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:18.863041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:18.863311 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:18.863444 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.864243 (+ 799us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.864491 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":55}
I20260811 07:32:18.870532 24350 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:53012:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:32:18.871938 24350 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:18.879841 25007 tablet_service.cc:1467] Processing CreateTablet for tablet c0717735a50d4119b5abaededfd75014 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=390fb8063aff4ae588590cfd72824de5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:32:18.879841 24571 tablet_service.cc:1467] Processing CreateTablet for tablet c0717735a50d4119b5abaededfd75014 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=390fb8063aff4ae588590cfd72824de5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:32:18.879980 24792 tablet_service.cc:1467] Processing CreateTablet for tablet c0717735a50d4119b5abaededfd75014 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=390fb8063aff4ae588590cfd72824de5]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:32:18.880499 24792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0717735a50d4119b5abaededfd75014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.880630 25007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0717735a50d4119b5abaededfd75014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.880630 24571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c0717735a50d4119b5abaededfd75014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:18.883839 25143 tablet_bootstrap.cc:492] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: Bootstrap starting.
I20260811 07:32:18.884878 25143 tablet_bootstrap.cc:654] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.885375 25140 tablet_bootstrap.cc:492] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: Bootstrap starting.
I20260811 07:32:18.885471 25141 tablet_bootstrap.cc:492] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: Bootstrap starting.
I20260811 07:32:18.886576 25140 tablet_bootstrap.cc:654] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.887156 25141 tablet_bootstrap.cc:654] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:18.887547 25143 tablet_bootstrap.cc:492] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: No bootstrap required, opened a new log
I20260811 07:32:18.887643 25143 ts_tablet_manager.cc:1397] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 07:32:18.888175 25140 tablet_bootstrap.cc:492] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: No bootstrap required, opened a new log
I20260811 07:32:18.888195 25143 raft_consensus.cc:348] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.888340 25143 raft_consensus.cc:374] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.888378 25143 raft_consensus.cc:729] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1920ed7e70914472af467d891c7cce2e, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.888355 25140 ts_tablet_manager.cc:1397] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:18.888561 25143 consensus_queue.cc:260] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.888784 25141 tablet_bootstrap.cc:492] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: No bootstrap required, opened a new log
I20260811 07:32:18.888885 25141 ts_tablet_manager.cc:1397] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:32:18.888897 25143 ts_tablet_manager.cc:1428] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:32:18.888932 25151 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.889096 25151 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:18.889022 25140 raft_consensus.cc:348] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.889178 25140 raft_consensus.cc:374] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.889217 25140 raft_consensus.cc:729] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5f8fd0939f54cc8b2ac7479d58f1f02, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.889369 25140 consensus_queue.cc:260] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.889405 25141 raft_consensus.cc:348] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.889519 25141 raft_consensus.cc:374] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:18.889552 25141 raft_consensus.cc:729] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bf61b2ba9f8420bb61ca0414fb84847, State: Initialized, Role: FOLLOWER
I20260811 07:32:18.889695 25140 ts_tablet_manager.cc:1428] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:32:18.889700 25141 consensus_queue.cc:260] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.889992 25150 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.890157 25150 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:18.889989 25141 ts_tablet_manager.cc:1428] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:32:18.889701 25154 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.891100 25154 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:18.894951 25151 raft_consensus.cc:482] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:18.895103 25151 raft_consensus.cc:504] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.896338 25151 leader_election.cc:288] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c5f8fd0939f54cc8b2ac7479d58f1f02 (127.22.4.193:36251), 7bf61b2ba9f8420bb61ca0414fb84847 (127.22.4.195:38377)
I20260811 07:32:18.902843 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.896890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:41889 (local address 127.22.4.195:38377)
0811 07:32:18.897046 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.897052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.897376 (+ 324us) server_negotiation.cc:407] Connection header received
0811 07:32:18.897629 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.897633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.897707 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.897812 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.898177 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.899068 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.901466 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.902092 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.902240 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.902300 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.902585 (+ 285us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.902661 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:32:18.902976 25195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.896785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:38377 (local address 127.22.4.194:41889)
0811 07:32:18.897225 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.897243 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.897391 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.897834 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.897836 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.897857 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.898039 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.898047 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.899206 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.899209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.901292 (+ 2083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.901306 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.902241 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.902245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.902386 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.902417 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.902568 (+ 151us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.902678 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":164,"thread_start_us":204,"threads_started":1}
I20260811 07:32:18.903195 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.896949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:60435 (local address 127.22.4.193:36251)
0811 07:32:18.897142 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.897148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.897558 (+ 410us) server_negotiation.cc:407] Connection header received
0811 07:32:18.897771 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.897775 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.897840 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.897934 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:18.898400 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.899165 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.901512 (+ 2347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.902147 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.902277 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.902352 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.902785 (+ 433us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.902987 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 07:32:18.903429 25036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0717735a50d4119b5abaededfd75014" candidate_uuid: "1920ed7e70914472af467d891c7cce2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" is_pre_election: true
I20260811 07:32:18.903620 25036 raft_consensus.cc:2454] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1920ed7e70914472af467d891c7cce2e in term 0.
I20260811 07:32:18.903836 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.896799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36251 (local address 127.22.4.194:60435)
0811 07:32:18.897429 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.897473 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.897620 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.897980 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.897984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.898003 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:18.898166 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.898174 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.899316 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.899319 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.901292 (+ 1973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.901306 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.902472 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.902476 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.902612 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.902642 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.903476 (+ 834us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.903614 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":278,"thread_start_us":212,"threads_started":1}
I20260811 07:32:18.904147 24724 leader_election.cc:302] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1920ed7e70914472af467d891c7cce2e, 7bf61b2ba9f8420bb61ca0414fb84847; no voters:
I20260811 07:32:18.904488 25151 raft_consensus.cc:2781] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:18.904565 25151 raft_consensus.cc:482] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:18.904596 25151 raft_consensus.cc:3037] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.904542 24600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0717735a50d4119b5abaededfd75014" candidate_uuid: "1920ed7e70914472af467d891c7cce2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" is_pre_election: true
I20260811 07:32:18.904850 24600 raft_consensus.cc:2454] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1920ed7e70914472af467d891c7cce2e in term 0.
I20260811 07:32:18.905992 25151 raft_consensus.cc:504] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.906435 25151 leader_election.cc:288] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [CANDIDATE]: Term 1 election: Requested vote from peers c5f8fd0939f54cc8b2ac7479d58f1f02 (127.22.4.193:36251), 7bf61b2ba9f8420bb61ca0414fb84847 (127.22.4.195:38377)
I20260811 07:32:18.907013 24600 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0717735a50d4119b5abaededfd75014" candidate_uuid: "1920ed7e70914472af467d891c7cce2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02"
I20260811 07:32:18.907195 24600 raft_consensus.cc:3037] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.907128 25036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0717735a50d4119b5abaededfd75014" candidate_uuid: "1920ed7e70914472af467d891c7cce2e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7bf61b2ba9f8420bb61ca0414fb84847"
I20260811 07:32:18.907338 25036 raft_consensus.cc:3037] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:18.908612 24600 raft_consensus.cc:2454] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1920ed7e70914472af467d891c7cce2e in term 1.
I20260811 07:32:18.908905 25036 raft_consensus.cc:2454] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1920ed7e70914472af467d891c7cce2e in term 1.
I20260811 07:32:18.909026 24726 leader_election.cc:302] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1920ed7e70914472af467d891c7cce2e, c5f8fd0939f54cc8b2ac7479d58f1f02; no voters:
I20260811 07:32:18.909286 25151 raft_consensus.cc:2781] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:18.909687 25151 raft_consensus.cc:686] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [term 1 LEADER]: Becoming Leader. State: Replica: 1920ed7e70914472af467d891c7cce2e, State: Running, Role: LEADER
I20260811 07:32:18.910059 25151 consensus_queue.cc:237] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } }
I20260811 07:32:18.912153 25197 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: TxnStatusTablet state changed. Reason: New leader 1920ed7e70914472af467d891c7cce2e. Latest consensus state: current_term: 1 leader_uuid: "1920ed7e70914472af467d891c7cce2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.912458 25197 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:32:18.912962 25200 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:32:18.913234 25200 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:32:18.913784 24351 catalog_manager.cc:5495] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1920ed7e70914472af467d891c7cce2e (127.22.4.194). New cstate: current_term: 1 leader_uuid: "1920ed7e70914472af467d891c7cce2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:18.934719 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.929387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.22.4.194:36567)
0811 07:32:18.929579 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.929585 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.929603 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:32:18.929761 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.929764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.929872 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.929985 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:18.930509 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.931152 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.932764 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.933032 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.933144 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.933692 (+ 548us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:18.934243 (+ 551us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:18.934359 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.934519 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.934582 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 07:32:18.934898 25187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.929201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36567 (local address 127.0.0.1:46228)
0811 07:32:18.929406 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.929430 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.929579 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.930092 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.930098 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.930115 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:32:18.930300 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.930308 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.931298 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.931302 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.932551 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.932567 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.933223 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.933230 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.933380 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.933483 (+ 103us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:32:18.934374 (+ 891us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:32:18.934395 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.934492 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.934642 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 07:32:18.939304 25036 raft_consensus.cc:1261] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Refusing update from remote peer 1920ed7e70914472af467d891c7cce2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:18.939553 24600 raft_consensus.cc:1261] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Refusing update from remote peer 1920ed7e70914472af467d891c7cce2e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:18.940024 25197 consensus_queue.cc:1035] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:18.940255 25151 consensus_queue.cc:1035] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:18.942610 25150 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: TxnStatusTablet state changed. Reason: New leader 1920ed7e70914472af467d891c7cce2e. Latest consensus state: current_term: 1 leader_uuid: "1920ed7e70914472af467d891c7cce2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.942775 25150 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:18.942903 25154 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: TxnStatusTablet state changed. Reason: New leader 1920ed7e70914472af467d891c7cce2e. Latest consensus state: current_term: 1 leader_uuid: "1920ed7e70914472af467d891c7cce2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.943193 25154 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:18.945159 25151 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1920ed7e70914472af467d891c7cce2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.945318 25151 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:32:18.946534 25160 mvcc.cc:205] Tried to move back new op lower bound from 7317231775487889408 to 7317231775379472384. Current Snapshot: MvccSnapshot[applied={T|T < 7317231775487889408 or (T in {7317231775487889408})}]
I20260811 07:32:18.947247 25151 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1920ed7e70914472af467d891c7cce2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.947384 25151 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P 1920ed7e70914472af467d891c7cce2e: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:32:18.947736 25161 mvcc.cc:205] Tried to move back new op lower bound from 7317231775487889408 to 7317231775379472384. Current Snapshot: MvccSnapshot[applied={T|T < 7317231775487889408}]
I20260811 07:32:18.947954 25150 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1920ed7e70914472af467d891c7cce2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.948073 25150 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P 7bf61b2ba9f8420bb61ca0414fb84847: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:18.952019 25154 tablet_replica.cc:439] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1920ed7e70914472af467d891c7cce2e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 } } peers { permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 } } peers { permanent_uuid: "7bf61b2ba9f8420bb61ca0414fb84847" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38377 } } }
I20260811 07:32:18.952236 25154 tablet_replica.cc:442] T c0717735a50d4119b5abaededfd75014 P c5f8fd0939f54cc8b2ac7479d58f1f02: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:18.959030 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.954645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36136 (local address 127.22.4.195:38377)
0811 07:32:18.954791 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.954796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.954816 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:32:18.954962 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.954964 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.955030 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.955157 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:18.955427 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.955943 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.956896 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.957514 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.957660 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.957964 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:18.958512 (+ 548us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:18.958658 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.958735 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.958796 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:32:18.977283 25210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.970456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36567 (local address 127.22.4.195:59913)
0811 07:32:18.971160 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:18.971179 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:18.971338 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:18.971765 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:18.971768 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:18.971777 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:32:18.972556 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.972568 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.973746 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.973751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.974935 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:18.974951 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.975860 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.975865 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:18.975980 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.976080 (+ 100us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:32:18.976799 (+ 719us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:32:18.976811 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 07:32:18.976899 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:32:18.977030 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":179,"threads_started":1}
I20260811 07:32:18.977295 25138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:18.970788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:59913 (local address 127.22.4.194:36567)
0811 07:32:18.971250 (+ 462us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:18.971258 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:18.971289 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:32:18.971534 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:18.971537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:18.971597 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:18.971709 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:18.972858 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.973574 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.975207 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:18.975578 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:18.975738 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:18.976364 (+ 626us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:18.976470 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:18.976776 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:18.976961 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 07:32:18.977113 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189}
I20260811 07:32:18.989367 24825 raft_consensus.cc:1261] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Refusing update from remote peer 7bf61b2ba9f8420bb61ca0414fb84847: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:18.989482 24600 raft_consensus.cc:1261] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Refusing update from remote peer 7bf61b2ba9f8420bb61ca0414fb84847: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:18.990036 25179 consensus_queue.cc:1035] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5f8fd0939f54cc8b2ac7479d58f1f02" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36251 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:18.990335 25150 consensus_queue.cc:1035] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1920ed7e70914472af467d891c7cce2e" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:19.022261 25133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:19.017215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:39777 (local address 127.22.4.195:38377)
0811 07:32:19.017398 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:19.017404 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:19.017783 (+ 379us) server_negotiation.cc:407] Connection header received
0811 07:32:19.017938 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:19.017941 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:19.017992 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:19.018067 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:19.018589 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:19.019361 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:19.021069 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:19.021318 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:19.021448 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:19.021771 (+ 323us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:19.021863 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:19.021947 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:19.022041 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 07:32:19.022097 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:32:19.022277 25219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:19.017134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:38377 (local address 127.22.4.194:39777)
0811 07:32:19.017643 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:19.017665 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:19.017829 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:19.018114 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:19.018117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:19.018125 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:32:19.018322 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:19.018329 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:19.019495 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:19.019499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:19.020932 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:19.020944 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:19.021453 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:19.021457 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:19.021564 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:19.021620 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:32:19.021954 (+ 334us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:32:19.021964 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:32:19.022032 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 07:32:19.022120 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":194,"threads_started":1}
I20260811 07:32:19.052814 24351 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:19.053071 24351 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:35590:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:19.055784 24351 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f59781d1d0ad461eb4a9c65f59a6f5cf: Sending DeleteTablet for 3 replicas of tablet 9737734d9ff8435fbe68e43fb2893a5b
I20260811 07:32:19.056622 25007 tablet_service.cc:1514] Processing DeleteTablet for tablet 9737734d9ff8435fbe68e43fb2893a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:19 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:42914
I20260811 07:32:19.056731 24571 tablet_service.cc:1514] Processing DeleteTablet for tablet 9737734d9ff8435fbe68e43fb2893a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:19 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:47178
I20260811 07:32:19.056926 25172 tablet_replica.cc:330] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: stopping tablet replica
I20260811 07:32:19.057034 25170 tablet_replica.cc:330] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: stopping tablet replica
I20260811 07:32:19.057111 25172 raft_consensus.cc:2229] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:19.057160 25170 raft_consensus.cc:2229] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:19.057307 25170 raft_consensus.cc:2258] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:19.057580 25172 raft_consensus.cc:2258] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:19.058082 24792 tablet_service.cc:1514] Processing DeleteTablet for tablet 9737734d9ff8435fbe68e43fb2893a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:19 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:45798
I20260811 07:32:19.058353 25171 tablet_replica.cc:330] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: stopping tablet replica
I20260811 07:32:19.058501 25170 ts_tablet_manager.cc:1905] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:19.059019 25172 ts_tablet_manager.cc:1905] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:19.059273 25171 raft_consensus.cc:2229] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:19.059449 25171 raft_consensus.cc:2258] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:19.060390 25171 ts_tablet_manager.cc:1905] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:19.062444 25170 ts_tablet_manager.cc:1918] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:19.062444 25172 ts_tablet_manager.cc:1918] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:19.062530 25172 log.cc:1196] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/9737734d9ff8435fbe68e43fb2893a5b
I20260811 07:32:19.062530 25170 log.cc:1196] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/9737734d9ff8435fbe68e43fb2893a5b
I20260811 07:32:19.062875 25170 ts_tablet_manager.cc:1939] T 9737734d9ff8435fbe68e43fb2893a5b P c5f8fd0939f54cc8b2ac7479d58f1f02: Deleting consensus metadata
I20260811 07:32:19.064098 25171 ts_tablet_manager.cc:1918] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:19.064074 24329 catalog_manager.cc:4841] TS c5f8fd0939f54cc8b2ac7479d58f1f02 (127.22.4.193:36251): tablet 9737734d9ff8435fbe68e43fb2893a5b (table test-table [id=d91fb50a83e848b1bbf03b1a270ea79a]) successfully deleted
I20260811 07:32:19.064203 25171 log.cc:1196] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/9737734d9ff8435fbe68e43fb2893a5b
I20260811 07:32:19.064534 25171 ts_tablet_manager.cc:1939] T 9737734d9ff8435fbe68e43fb2893a5b P 1920ed7e70914472af467d891c7cce2e: Deleting consensus metadata
I20260811 07:32:19.065573 24331 catalog_manager.cc:4841] TS 1920ed7e70914472af467d891c7cce2e (127.22.4.194:36567): tablet 9737734d9ff8435fbe68e43fb2893a5b (table test-table [id=d91fb50a83e848b1bbf03b1a270ea79a]) successfully deleted
I20260811 07:32:19.071182 25172 ts_tablet_manager.cc:1939] T 9737734d9ff8435fbe68e43fb2893a5b P 7bf61b2ba9f8420bb61ca0414fb84847: Deleting consensus metadata
I20260811 07:32:19.072804 24326 catalog_manager.cc:4841] TS 7bf61b2ba9f8420bb61ca0414fb84847 (127.22.4.195:38377): tablet 9737734d9ff8435fbe68e43fb2893a5b (table test-table [id=d91fb50a83e848b1bbf03b1a270ea79a]) successfully deleted
Aug 11 07:32:19 dist-test-slave-7z32 krb5kdc[24285](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433538, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:19.087983 25135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:19.073027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42786 (local address 127.22.4.193:36251)
0811 07:32:19.073177 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:19.073181 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:19.073919 (+ 738us) server_negotiation.cc:407] Connection header received
0811 07:32:19.074135 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:19.074139 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:19.074193 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:19.074250 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:19.075441 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:19.076246 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:19.077807 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:19.078161 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:19.078238 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:19.082806 (+ 4568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:19.082849 (+ 43us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:19.082872 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:19.082913 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:19.085338 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:19.085979 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:19.085987 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:19.085989 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:19.086089 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:19.086459 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:19.086463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:19.086464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:19.086947 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:19.087135 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:19.087644 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 07:32:19.087791 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
W20260811 07:32:19.089282 24669 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:42786
I20260811 07:32:19.104754 24422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:19.093056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53024 (local address 127.22.4.254:35439)
0811 07:32:19.093267 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:19.093273 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:19.093562 (+ 289us) server_negotiation.cc:407] Connection header received
0811 07:32:19.093831 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:19.093835 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:19.093901 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:19.093968 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:19.095202 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:19.096095 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:19.097500 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:19.097967 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:19.098091 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:19.100307 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:19.100311 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:19.100315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:19.100356 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:19.102444 (+ 2088us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:19.103087 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:19.103091 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:19.103093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:19.103196 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:19.103568 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:19.103571 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:19.103573 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:19.103815 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:19.103951 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:19.104430 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 07:32:19.104571 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260811 07:32:19.105947 24351 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53024
I20260811 07:32:19.107960 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24461
I20260811 07:32:19.160686 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24691
I20260811 07:32:19.177572 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24904
I20260811 07:32:19.207541 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24305
2026-08-11T07:32:19Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (3677 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:19 dist-test-slave-7z32 krb5kdc[25237](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:19 dist-test-slave-7z32 krb5kdc[25237](info): set up 2 sockets
Aug 11 07:32:19 dist-test-slave-7z32 krb5kdc[25237](info): commencing operation
krb5kdc: starting...
W20260811 07:32:20.567831 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.002s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:20 dist-test-slave-7z32 krb5kdc[25237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:20.739245 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34603
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:46635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34603
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:20.888957 25254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:20.889390 25254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:20.889443 25254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:20.894487 25254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:20.894642 25254 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:32:20.894663 25254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:20.894685 25254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:20.894703 25254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:20.894721 25254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:20.901527 25254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:46635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34603
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34603
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:20.903276 25254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:20.904672 25254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:32:20.916594 25254 server_base.cc:1034] running on GCE node
W20260811 07:32:20.916572 25261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:20.916571 25262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:20.916640 25264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:20.917932 25254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:20.919433 25254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:20.920652 25254 hybrid_clock.cc:648] HybridClock initialized: now 1786433540920619 us; error 78 us; skew 500 ppm
Aug 11 07:32:20 dist-test-slave-7z32 krb5kdc[25237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433540, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:20.928206 25254 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:20.929509 25254 webserver.cc:460] Webserver started at http://127.22.4.254:43071/ using document root <none> and password file <none>
I20260811 07:32:20.930265 25254 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:20.930377 25254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:20.930639 25254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:20.933112 25254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "34260eb0154a4297a9db63b63d0e81f3"
format_stamp: "Formatted at 2026-08-11 07:32:20 on dist-test-slave-7z32"
server_key: "d3a53a50688a704104d08c90203000bc"
server_key_iv: "974edd0e97f0cd0502c5f9ce444e8ef1"
server_key_version: "encryptionkey@0"
I20260811 07:32:20.933759 25254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "34260eb0154a4297a9db63b63d0e81f3"
format_stamp: "Formatted at 2026-08-11 07:32:20 on dist-test-slave-7z32"
server_key: "d3a53a50688a704104d08c90203000bc"
server_key_iv: "974edd0e97f0cd0502c5f9ce444e8ef1"
server_key_version: "encryptionkey@0"
I20260811 07:32:20.938628 25254 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:20.942140 25279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:20.944038 25254 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:20.944247 25254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "34260eb0154a4297a9db63b63d0e81f3"
format_stamp: "Formatted at 2026-08-11 07:32:20 on dist-test-slave-7z32"
server_key: "d3a53a50688a704104d08c90203000bc"
server_key_iv: "974edd0e97f0cd0502c5f9ce444e8ef1"
server_key_version: "encryptionkey@0"
I20260811 07:32:20.944401 25254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:20.968747 25254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:20.973165 25254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:20.973446 25254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:20.984009 25254 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:34603
I20260811 07:32:20.984063 25380 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:34603 every 8 connection(s)
I20260811 07:32:20.985275 25254 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:20.989763 25381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:20.991065 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 25254
I20260811 07:32:20.991231 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:20.991576 22547 external_mini_cluster.cc:1428] Setting key f98f107a42a05a6b2efaa6ba0a1a2a96
I20260811 07:32:20.999289 25381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: Bootstrap starting.
I20260811 07:32:21.003576 25381 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: Neither blocks nor log segments found. Creating new log.
Aug 11 07:32:20 dist-test-slave-7z32 krb5kdc[25237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433540, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:21.004758 25381 log.cc:824] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:21.008139 25381 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: No bootstrap required, opened a new log
I20260811 07:32:21.012893 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:20.993690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50176 (local address 127.22.4.254:34603)
0811 07:32:20.994254 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:20.994274 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:20.994317 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:32:20.995346 (+ 1029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:20.995375 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:20.995808 (+ 433us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:20.996180 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:20.997593 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:20.998820 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.000405 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.000970 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.001127 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.005203 (+ 4076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:21.005211 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:21.005232 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:21.005275 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:21.008679 (+ 3404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.009515 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.009521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.009528 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.009682 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.010120 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.010124 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.010125 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.010692 (+ 567us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:21.010971 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:21.011437 (+ 466us) server_negotiation.cc:299] Negotiation successful
0811 07:32:21.011902 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":380,"thread_start_us":207,"threads_started":1}
I20260811 07:32:21.013118 25381 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34260eb0154a4297a9db63b63d0e81f3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34603 } }
I20260811 07:32:21.013520 25381 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:21.013615 25381 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34260eb0154a4297a9db63b63d0e81f3, State: Initialized, Role: FOLLOWER
I20260811 07:32:21.014552 25381 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34260eb0154a4297a9db63b63d0e81f3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34603 } }
I20260811 07:32:21.014775 25381 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:21.014916 25381 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:21.015084 25381 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:21.016372 25381 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34260eb0154a4297a9db63b63d0e81f3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34603 } }
I20260811 07:32:21.016834 25381 leader_election.cc:302] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34260eb0154a4297a9db63b63d0e81f3; no voters:
I20260811 07:32:21.017350 25381 leader_election.cc:288] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:21.017663 25391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:21.018241 25391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [term 1 LEADER]: Becoming Leader. State: Replica: 34260eb0154a4297a9db63b63d0e81f3, State: Running, Role: LEADER
I20260811 07:32:21.018745 25391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34260eb0154a4297a9db63b63d0e81f3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34603 } }
I20260811 07:32:21.019251 25381 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:21.021051 25393 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34260eb0154a4297a9db63b63d0e81f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34260eb0154a4297a9db63b63d0e81f3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34603 } } }
I20260811 07:32:21.021245 25393 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:21.021695 25394 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34260eb0154a4297a9db63b63d0e81f3. Latest consensus state: current_term: 1 leader_uuid: "34260eb0154a4297a9db63b63d0e81f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34260eb0154a4297a9db63b63d0e81f3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34603 } } }
I20260811 07:32:21.021800 25394 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3 [sys.catalog]: This master's current role is: LEADER
W20260811 07:32:21.026024 25414 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:21.026190 25414 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:21.026294 25410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:21.027704 25410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:21.038240 25410 catalog_manager.cc:1347] Generated new cluster ID: d187cc3117a04b12a2a41e5d489d3acb
I20260811 07:32:21.038373 25410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:21.056200 25410 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:21.057876 25410 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:21.070726 25410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: Generated new TSK 0
I20260811 07:32:21.072113 25410 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:21.131554 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34603
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:46635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:21.311582 25427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:21.312016 25427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:21.312076 25427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:21.317252 25427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:21.317370 25427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:21.317425 25427 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:32:21.317441 25427 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:21.317481 25427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:21.326776 25427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:46635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:21.328670 25427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:21.330159 25427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:21.344106 25436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:21.344259 25435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:21.344360 25427 server_base.cc:1034] running on GCE node
W20260811 07:32:21.344259 25439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:21.345104 25427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:21.345976 25427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:21.349309 25427 hybrid_clock.cc:648] HybridClock initialized: now 1786433541349251 us; error 74 us; skew 500 ppm
Aug 11 07:32:21 dist-test-slave-7z32 krb5kdc[25237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433541, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:21.353150 25427 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:21.354336 25427 webserver.cc:460] Webserver started at http://127.22.4.193:32771/ using document root <none> and password file <none>
I20260811 07:32:21.355110 25427 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:21.355188 25427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:21.355400 25427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:21.357767 25427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "2435350735ba49d3a8cbc2a2eec7b987"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "296220ce542f4e163f2601d60aae84d2"
server_key_iv: "78fe64b50d10e623d50b04e201821090"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.358398 25427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "2435350735ba49d3a8cbc2a2eec7b987"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "296220ce542f4e163f2601d60aae84d2"
server_key_iv: "78fe64b50d10e623d50b04e201821090"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.363852 25427 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:32:21.367175 25454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:21.369036 25427 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:21.369264 25427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "2435350735ba49d3a8cbc2a2eec7b987"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "296220ce542f4e163f2601d60aae84d2"
server_key_iv: "78fe64b50d10e623d50b04e201821090"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.369426 25427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:21.387844 25427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:21.392817 25427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:21.393091 25427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:21.395152 25427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:21.395236 25427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:21.395418 25427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:21.395557 25427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:32:21 dist-test-slave-7z32 krb5kdc[25237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433541, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:21.409440 25427 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:36029
I20260811 07:32:21.409528 25633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:36029 every 8 connection(s)
I20260811 07:32:21.410782 25427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:21.415923 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.396673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:55217 (local address 127.22.4.254:34603)
0811 07:32:21.396924 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:21.396930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:21.398326 (+ 1396us) server_negotiation.cc:407] Connection header received
0811 07:32:21.399959 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:21.399967 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:21.400082 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:21.400271 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:21.402342 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.403422 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.405679 (+ 2257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.406104 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.406254 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.410584 (+ 4330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:21.410590 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:21.410594 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:21.410638 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:21.412885 (+ 2247us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.413673 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.413677 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.413678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.413790 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.414203 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.414206 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.414208 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.414470 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:21.414645 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:21.415474 (+ 829us) server_negotiation.cc:299] Negotiation successful
0811 07:32:21.415736 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 07:32:21.416711 25470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.397280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34603 (local address 127.22.4.193:55217)
0811 07:32:21.398058 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:21.398136 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:21.399583 (+ 1447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:21.400531 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:21.400544 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:21.401192 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:21.402082 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.402111 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.403678 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.403683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.405453 (+ 1770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.405471 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.406403 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.406411 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.406725 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.407843 (+ 1118us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:21.407877 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:21.410174 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:21.413087 (+ 2913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:21.413094 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:21.413108 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:21.413503 (+ 395us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:21.413902 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:21.413904 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:21.413906 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:21.414062 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:21.414650 (+ 588us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:21.414656 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:21.415145 (+ 489us) client_negotiation.cc:769] Sending connection context
0811 07:32:21.415405 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 07:32:21.415744 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":191,"threads_started":1}
I20260811 07:32:21.418676 25634 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34603
I20260811 07:32:21.418996 25634 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:21.419647 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 25427
I20260811 07:32:21.419853 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:21.419876 25634 heartbeater.cc:511] Master 127.22.4.254:34603 requested a full tablet report, sending...
I20260811 07:32:21.420354 22547 external_mini_cluster.cc:1428] Setting key 03480ae47e05643c150c2bfc2084aef8
I20260811 07:32:21.422202 25303 ts_manager.cc:194] Registered new tserver with Master: 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029)
I20260811 07:32:21.423950 25303 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:55217
I20260811 07:32:21.432744 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.422447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:51709 (local address 127.22.4.254:34603)
0811 07:32:21.422624 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:21.422631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:21.423212 (+ 581us) server_negotiation.cc:407] Connection header received
0811 07:32:21.423393 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:21.423398 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:21.423453 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:21.423557 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:21.424307 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.425105 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.426305 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.426631 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.426709 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.428567 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:21.428572 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:21.428575 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:21.428619 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:21.430533 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.431235 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.431239 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.431241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.431348 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.431728 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.431731 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.431732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.431986 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:21.432077 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:21.432471 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 07:32:21.432603 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:32:21.432873 25641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.422082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34603 (local address 127.22.4.193:51709)
0811 07:32:21.423084 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:21.423105 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:21.423261 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:21.423609 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:21.423616 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:21.423951 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:21.424153 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.424165 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.425283 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.425288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.426158 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.426169 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.426917 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.426921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.427018 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.427741 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:21.427762 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:21.428343 (+ 581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:21.430662 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:21.430670 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:21.430675 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:21.431084 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:21.431472 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:21.431478 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:21.431482 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:21.431611 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:21.432109 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:21.432114 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:21.432256 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 07:32:21.432392 (+ 136us) client_negotiation.cc:240] Negotiation successful
0811 07:32:21.432596 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":865,"thread_start_us":150,"threads_started":1}
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:21.464406 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34603
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:46635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:21.605827 25647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:21.606153 25647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:21.606202 25647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:21.610574 25647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:21.610661 25647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:21.610704 25647 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:32:21.610720 25647 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:21.610755 25647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:21.616561 25647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:46635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:21.617775 25647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:21.619041 25647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:21.631595 25656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:21.631654 25653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:21.631623 25658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:21.632145 25647 server_base.cc:1034] running on GCE node
I20260811 07:32:21.632607 25647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:21.633312 25647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:21.634562 25647 hybrid_clock.cc:648] HybridClock initialized: now 1786433541634509 us; error 65 us; skew 500 ppm
Aug 11 07:32:21 dist-test-slave-7z32 krb5kdc[25237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433541, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:21.637805 25647 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:21.638962 25647 webserver.cc:460] Webserver started at http://127.22.4.194:36475/ using document root <none> and password file <none>
I20260811 07:32:21.639591 25647 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:21.639660 25647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:21.639851 25647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:21.642376 25647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "2af30be9d11eedb20d30ddca94dca249"
server_key_iv: "dc0ff107b4ee3acf1e99db7023f55820"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.643142 25647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "2af30be9d11eedb20d30ddca94dca249"
server_key_iv: "dc0ff107b4ee3acf1e99db7023f55820"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.648135 25647 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:32:21.651854 25671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:21.653700 25647 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:21.653867 25647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "2af30be9d11eedb20d30ddca94dca249"
server_key_iv: "dc0ff107b4ee3acf1e99db7023f55820"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.654076 25647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:21.672240 25647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:21.676026 25647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:21.676252 25647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:21.678203 25647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:21.678296 25647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:21.678356 25647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:21.678380 25647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:32:21 dist-test-slave-7z32 krb5kdc[25237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433541, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:21.691530 25647 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:38461
I20260811 07:32:21.691813 25851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:38461 every 8 connection(s)
I20260811 07:32:21.693004 25647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:21.695808 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 25647
I20260811 07:32:21.696003 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:21.696401 22547 external_mini_cluster.cc:1428] Setting key 00d921c3fb34c798271af7e0bef68863
I20260811 07:32:21.698608 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.679302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:58733 (local address 127.22.4.254:34603)
0811 07:32:21.679711 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:21.679716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:21.680759 (+ 1043us) server_negotiation.cc:407] Connection header received
0811 07:32:21.682612 (+ 1853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:21.682616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:21.682699 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:21.682814 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:21.684729 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.685805 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.687932 (+ 2127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.688209 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.688338 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.692811 (+ 4473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:21.692816 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:21.692818 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:21.692862 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:21.694958 (+ 2096us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.695839 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.695847 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.695854 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.696000 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.696595 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.696600 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.696602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.696949 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:21.697097 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:21.698207 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0811 07:32:21.698413 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220}
I20260811 07:32:21.700053 25682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.679747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34603 (local address 127.22.4.194:58733)
0811 07:32:21.680445 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:21.680524 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:21.682253 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:21.683091 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:21.683101 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:21.683838 (+ 737us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:21.684522 (+ 684us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.684541 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.685960 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.685968 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.687769 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.687784 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.688419 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.688423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.688641 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.689591 (+ 950us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:21.689627 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:21.692446 (+ 2819us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:21.695130 (+ 2684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:21.695135 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:21.695151 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:21.695624 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:21.696146 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:21.696150 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:21.696152 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:21.696394 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:21.697150 (+ 756us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:21.697159 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:21.697656 (+ 497us) client_negotiation.cc:769] Sending connection context
0811 07:32:21.698048 (+ 392us) client_negotiation.cc:240] Negotiation successful
0811 07:32:21.698644 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":161,"threads_started":1}
I20260811 07:32:21.702077 25853 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34603
I20260811 07:32:21.702347 25853 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:21.703322 25853 heartbeater.cc:511] Master 127.22.4.254:34603 requested a full tablet report, sending...
I20260811 07:32:21.705044 25299 ts_manager.cc:194] Registered new tserver with Master: ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461)
I20260811 07:32:21.705896 25299 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:58733
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:21.715477 25863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.704676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34603 (local address 127.22.4.194:42187)
0811 07:32:21.705131 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:21.705151 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:21.705312 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:21.705741 (+ 429us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:21.705744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:21.706023 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:21.706176 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.706188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.707624 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.707628 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.708425 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.708435 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.709233 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.709236 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.709319 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.710117 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:21.710138 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:21.710540 (+ 402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:21.713214 (+ 2674us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:21.713217 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:21.713218 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:21.713523 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:21.714013 (+ 490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:21.714016 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:21.714018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:21.714119 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:21.714711 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:21.714714 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:21.714936 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 07:32:21.715047 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 07:32:21.715232 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"thread_start_us":198,"threads_started":1}
I20260811 07:32:21.715543 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.704682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:42187 (local address 127.22.4.254:34603)
0811 07:32:21.704830 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:21.704834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:21.705231 (+ 397us) server_negotiation.cc:407] Connection header received
0811 07:32:21.705477 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:21.705486 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:21.705576 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:21.705711 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:21.706358 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.707440 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.708580 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.709043 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.709206 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.710909 (+ 1703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:21.710923 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:21.710930 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:21.710972 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:21.713070 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.713757 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.713761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.713762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.713867 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:21.714243 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:21.714246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:21.714248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:21.714537 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:21.714702 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:21.715180 (+ 478us) server_negotiation.cc:299] Negotiation successful
0811 07:32:21.715320 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:21.739831 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34603
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:46635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:21.899427 25867 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:21.899905 25867 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:21.900002 25867 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:21.904660 25867 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:21.904819 25867 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:21.904907 25867 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 07:32:21.904955 25867 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:21.905033 25867 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:21.912791 25867 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:46635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:34603
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25867
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:21.914570 25867 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:21.916285 25867 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:21.929886 25874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:21.929996 25876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:21.930022 25867 server_base.cc:1034] running on GCE node
W20260811 07:32:21.929920 25878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:21.931066 25867 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:21.931885 25867 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:21.933101 25867 hybrid_clock.cc:648] HybridClock initialized: now 1786433541933075 us; error 44 us; skew 500 ppm
Aug 11 07:32:21 dist-test-slave-7z32 krb5kdc[25237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433541, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:21.936712 25867 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:21.937973 25867 webserver.cc:460] Webserver started at http://127.22.4.195:46789/ using document root <none> and password file <none>
I20260811 07:32:21.938681 25867 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:21.938791 25867 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:21.939226 25867 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:21.941720 25867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "cc3d2903e89b4f93a10eec69fa568dad"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "4154c7d3ea043ccb919a4c60f315e15c"
server_key_iv: "379f637c3fe8a35cfb22e706c27f7060"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.942305 25867 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "cc3d2903e89b4f93a10eec69fa568dad"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "4154c7d3ea043ccb919a4c60f315e15c"
server_key_iv: "379f637c3fe8a35cfb22e706c27f7060"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.947501 25867 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 07:32:21.951673 25888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:21.954068 25867 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:32:21.954382 25867 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "cc3d2903e89b4f93a10eec69fa568dad"
format_stamp: "Formatted at 2026-08-11 07:32:21 on dist-test-slave-7z32"
server_key: "4154c7d3ea043ccb919a4c60f315e15c"
server_key_iv: "379f637c3fe8a35cfb22e706c27f7060"
server_key_version: "encryptionkey@0"
I20260811 07:32:21.954571 25867 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:21.977669 25867 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:21.982928 25867 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:21.983203 25867 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:21.985443 25867 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:21.985553 25867 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:21.985615 25867 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:21.985639 25867 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:21.998615 25867 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:33139
I20260811 07:32:21.998970 26067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:33139 every 8 connection(s)
I20260811 07:32:22.000007 25867 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:32:21 dist-test-slave-7z32 krb5kdc[25237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433541, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:22.002208 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 25867
I20260811 07:32:22.002355 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:22.002790 22547 external_mini_cluster.cc:1428] Setting key 6b7eedf9c02e16e1bbb0664ad93fcb76
I20260811 07:32:22.007530 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.987457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:49293 (local address 127.22.4.254:34603)
0811 07:32:21.987676 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:21.987683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:21.989696 (+ 2013us) server_negotiation.cc:407] Connection header received
0811 07:32:21.991547 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:21.991552 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:21.991642 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:21.991719 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:21.994369 (+ 2650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.995329 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.997820 (+ 2491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.998204 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.998374 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.002806 (+ 4432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:22.002811 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:22.002815 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:22.002885 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:22.004906 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:22.005675 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:22.005680 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:22.005682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:22.005800 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:22.006215 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:22.006239 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:22.006240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:22.006462 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:22.006549 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.007253 (+ 704us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.007388 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:32:22.008504 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:21.988200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34603 (local address 127.22.4.195:49293)
0811 07:32:21.989454 (+ 1254us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:21.989550 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:21.991157 (+ 1607us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:21.992394 (+ 1237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:21.992409 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:21.993082 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:21.994032 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.994063 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.995541 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.995545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.997539 (+ 1994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:21.997558 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:21.998669 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:21.998675 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:21.999012 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:21.999914 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:21.999940 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:22.002398 (+ 2458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:22.005058 (+ 2660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:22.005065 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:22.005083 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:22.005536 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:22.005896 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:22.005900 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:22.005902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:22.006126 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:22.006574 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:22.006581 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:22.006980 (+ 399us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.007177 (+ 197us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.007513 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":885,"thread_start_us":231,"threads_started":1}
I20260811 07:32:22.010130 26068 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34603
I20260811 07:32:22.010442 26068 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:22.011237 26068 heartbeater.cc:511] Master 127.22.4.254:34603 requested a full tablet report, sending...
I20260811 07:32:22.012717 25303 ts_manager.cc:194] Registered new tserver with Master: cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139)
I20260811 07:32:22.013484 25303 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:49293
I20260811 07:32:22.019201 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:32:22.024181 26079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.013668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34603 (local address 127.22.4.195:60895)
0811 07:32:22.014130 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.014151 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.014290 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.014665 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.014680 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.015072 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:22.015223 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.015231 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.016523 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.016527 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.017456 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.017474 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.018155 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.018161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.018280 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.019007 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:22.019029 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:22.019566 (+ 537us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:22.022108 (+ 2542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:22.022116 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:22.022122 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:22.022498 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:22.022985 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:22.022988 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:22.022989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:22.023086 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:22.023619 (+ 533us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:22.023621 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:22.023740 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.023841 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.024016 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":146,"threads_started":1}
I20260811 07:32:22.024361 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.013779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:60895 (local address 127.22.4.254:34603)
0811 07:32:22.013967 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.013974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.014298 (+ 324us) server_negotiation.cc:407] Connection header received
0811 07:32:22.014428 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.014432 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.014501 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.014632 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:22.015376 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.016162 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.017631 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.017923 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.018099 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.019763 (+ 1664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:22.019767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:22.019770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:22.019798 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:22.021952 (+ 2154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:22.022670 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:22.022676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:22.022678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:22.022817 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:22.023193 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:22.023199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:22.023202 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:22.023503 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:22.023624 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.023939 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.024113 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 07:32:22 dist-test-slave-7z32 krb5kdc[25237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:32:22 dist-test-slave-7z32 krb5kdc[25237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:22.057394 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.045263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50186 (local address 127.22.4.254:34603)
0811 07:32:22.045500 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.045506 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.045707 (+ 201us) server_negotiation.cc:407] Connection header received
0811 07:32:22.045931 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.045935 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.046005 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.046143 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:22.047230 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.047902 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.049148 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.049480 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.049701 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.053209 (+ 3508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:22.053213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:22.053215 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:22.053255 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:22.055024 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:22.055605 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:22.055609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:22.055613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:22.055713 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:22.056217 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:22.056224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:22.056227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:22.056497 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:22.056679 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.057015 (+ 336us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.057183 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 07:32:22.062618 25303 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50186:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:22.066465 25303 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:22.085601 26098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.078408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:38461 (local address 127.0.0.1:38756)
0811 07:32:22.079512 (+ 1104us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.079581 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.079756 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.080540 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.080547 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.080576 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.080760 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.080769 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.082395 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.082398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.083835 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.083846 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.084857 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.084861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.085002 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.085060 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.085212 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.085392 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":930,"mutex_wait_us":250,"thread_start_us":208,"threads_started":1}
I20260811 07:32:22.086005 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.078781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38756 (local address 127.22.4.194:38461)
0811 07:32:22.079987 (+ 1206us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.080000 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.080023 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:32:22.080100 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.080104 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.080322 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.080498 (+ 176us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.080921 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.082238 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.083976 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.084700 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.084820 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.085031 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.085271 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.085402 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1090,"thread_start_us":186,"threads_started":1}
I20260811 07:32:22.087065 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.079831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53658 (local address 127.22.4.195:33139)
0811 07:32:22.080369 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.080380 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.080402 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:32:22.080519 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.080525 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.080763 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.080946 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.081220 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.082262 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.084718 (+ 2456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.085678 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.085946 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.086675 (+ 729us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.086732 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.086891 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":174,"threads_started":1}
I20260811 07:32:22.087548 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.078563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35416 (local address 127.22.4.193:36029)
0811 07:32:22.079258 (+ 695us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.079268 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.079700 (+ 432us) server_negotiation.cc:407] Connection header received
0811 07:32:22.080000 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.080008 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.080323 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.080498 (+ 175us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.081055 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.082235 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.084662 (+ 2427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.085503 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.085619 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.085764 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.087286 (+ 1522us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.087410 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":102,"threads_started":1}
I20260811 07:32:22.087575 26099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.078207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36029 (local address 127.0.0.1:35416)
0811 07:32:22.079515 (+ 1308us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.079584 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.079802 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.080731 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.080733 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.080750 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.080902 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.080909 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.082394 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.082398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.084477 (+ 2079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.084493 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.085843 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.085847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.085951 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.085994 (+ 43us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.086098 (+ 104us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.087441 (+ 1343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1056,"mutex_wait_us":295,"thread_start_us":148,"threads_started":1}
I20260811 07:32:22.087955 26103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.079299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:33139 (local address 127.0.0.1:53658)
0811 07:32:22.080060 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.080076 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.080178 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.080946 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.080949 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.080967 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.081085 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.081098 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.082413 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.082417 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.084561 (+ 2144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.084572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.086220 (+ 1648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.086224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.086322 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.086347 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.086447 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.087842 (+ 1395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":1508,"thread_start_us":130,"threads_started":1}
I20260811 07:32:22.089839 25751 tablet_service.cc:1467] Processing CreateTablet for tablet a016a76ad87540359d13fb26015ffb06 (DEFAULT_TABLE table=test-table [id=a89c360fb3c1428fae97425c3dc2c079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:22.091501 25751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a016a76ad87540359d13fb26015ffb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.091125 25530 tablet_service.cc:1467] Processing CreateTablet for tablet a016a76ad87540359d13fb26015ffb06 (DEFAULT_TABLE table=test-table [id=a89c360fb3c1428fae97425c3dc2c079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:22.091127 25967 tablet_service.cc:1467] Processing CreateTablet for tablet a016a76ad87540359d13fb26015ffb06 (DEFAULT_TABLE table=test-table [id=a89c360fb3c1428fae97425c3dc2c079]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:22.092495 25530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a016a76ad87540359d13fb26015ffb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.092645 25967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a016a76ad87540359d13fb26015ffb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.100067 26107 tablet_bootstrap.cc:492] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Bootstrap starting.
I20260811 07:32:22.102684 26111 tablet_bootstrap.cc:492] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Bootstrap starting.
I20260811 07:32:22.103048 26109 tablet_bootstrap.cc:492] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Bootstrap starting.
I20260811 07:32:22.103726 26107 tablet_bootstrap.cc:654] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.104727 26107 log.cc:824] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:22.105268 26111 tablet_bootstrap.cc:654] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.105640 26109 tablet_bootstrap.cc:654] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.106281 26111 log.cc:824] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:22.106650 26109 log.cc:824] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:22.107857 26107 tablet_bootstrap.cc:492] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: No bootstrap required, opened a new log
I20260811 07:32:22.108125 26107 ts_tablet_manager.cc:1397] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:32:22.108952 26111 tablet_bootstrap.cc:492] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: No bootstrap required, opened a new log
I20260811 07:32:22.109226 26111 ts_tablet_manager.cc:1397] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260811 07:32:22.109289 26109 tablet_bootstrap.cc:492] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: No bootstrap required, opened a new log
I20260811 07:32:22.109462 26109 ts_tablet_manager.cc:1397] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:32:22.112080 26107 raft_consensus.cc:348] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.112380 26107 raft_consensus.cc:374] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.112439 26107 raft_consensus.cc:729] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2a5ba9fd614b6ca3e91628f81b44a3, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.112952 26107 consensus_queue.cc:260] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.113723 25853 heartbeater.cc:503] Master 127.22.4.254:34603 was elected leader, sending a full tablet report...
I20260811 07:32:22.114176 26107 ts_tablet_manager.cc:1428] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260811 07:32:22.114346 26109 raft_consensus.cc:348] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.114346 26111 raft_consensus.cc:348] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.114732 26109 raft_consensus.cc:374] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.114732 26111 raft_consensus.cc:374] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.114815 26109 raft_consensus.cc:729] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc3d2903e89b4f93a10eec69fa568dad, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.114802 26111 raft_consensus.cc:729] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2435350735ba49d3a8cbc2a2eec7b987, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.115465 26109 consensus_queue.cc:260] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.115594 26111 consensus_queue.cc:260] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.116854 25634 heartbeater.cc:503] Master 127.22.4.254:34603 was elected leader, sending a full tablet report...
I20260811 07:32:22.117167 26111 ts_tablet_manager.cc:1428] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260811 07:32:22.117449 26068 heartbeater.cc:503] Master 127.22.4.254:34603 was elected leader, sending a full tablet report...
I20260811 07:32:22.118899 26109 ts_tablet_manager.cc:1428] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
W20260811 07:32:22.162662 25635 tablet.cc:2369] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:32:22.195339 25854 tablet.cc:2369] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:22.232275 26123 raft_consensus.cc:482] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:22.232534 26123 raft_consensus.cc:504] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.234055 26123 leader_election.cc:288] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029), ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461)
I20260811 07:32:22.236493 26117 raft_consensus.cc:482] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:22.236815 26117 raft_consensus.cc:504] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.238514 26117 leader_election.cc:288] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029), cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139)
I20260811 07:32:22.240036 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.234488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:38461 (local address 127.22.4.195:44409)
0811 07:32:22.234730 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.234748 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.234929 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.235521 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.235524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.235541 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.235657 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.235663 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.236801 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.236804 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.237920 (+ 1116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.237931 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.239368 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.239375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.239549 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.239587 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.239702 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.239825 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144}
I20260811 07:32:22.240329 26100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.234679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:59895 (local address 127.22.4.193:36029)
0811 07:32:22.234814 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.234818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.235421 (+ 603us) server_negotiation.cc:407] Connection header received
0811 07:32:22.235524 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.235528 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.235613 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.235727 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.236548 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.237362 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.238631 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.239370 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.239542 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.239606 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.240081 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.240171 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 07:32:22.240742 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.235018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:44409 (local address 127.22.4.194:38461)
0811 07:32:22.235182 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.235186 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.235201 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:32:22.235267 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.235270 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.235338 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.235437 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.235813 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.236645 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.238096 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.238979 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.239178 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.239266 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.240409 (+ 1143us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.240561 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":78}
I20260811 07:32:22.240835 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.234666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36029 (local address 127.22.4.195:59895)
0811 07:32:22.235269 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.235285 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.235401 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.235759 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.235763 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.235790 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.236367 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.236378 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.237512 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.237517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.238415 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.238453 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.239676 (+ 1223us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.239681 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.239918 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.239949 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.240561 (+ 612us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.240670 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":243,"threads_started":1}
I20260811 07:32:22.241542 25784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a016a76ad87540359d13fb26015ffb06" candidate_uuid: "cc3d2903e89b4f93a10eec69fa568dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" is_pre_election: true
I20260811 07:32:22.241778 25547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a016a76ad87540359d13fb26015ffb06" candidate_uuid: "cc3d2903e89b4f93a10eec69fa568dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2435350735ba49d3a8cbc2a2eec7b987" is_pre_election: true
I20260811 07:32:22.241878 25784 raft_consensus.cc:2454] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc3d2903e89b4f93a10eec69fa568dad in term 0.
I20260811 07:32:22.242198 25547 raft_consensus.cc:2454] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc3d2903e89b4f93a10eec69fa568dad in term 0.
I20260811 07:32:22.242491 25895 leader_election.cc:302] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ba2a5ba9fd614b6ca3e91628f81b44a3, cc3d2903e89b4f93a10eec69fa568dad; no voters:
I20260811 07:32:22.243099 26123 raft_consensus.cc:2781] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:22.243208 26123 raft_consensus.cc:482] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:22.243273 26123 raft_consensus.cc:3037] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.244652 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.238762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36029 (local address 127.22.4.194:45641)
0811 07:32:22.239158 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.239179 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.239297 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.240269 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.240272 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.240403 (+ 131us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.240554 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.240562 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.241631 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.241635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.242917 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.242930 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.244042 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.244047 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.244167 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.244253 (+ 86us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.244345 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.244455 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":35,"spinlock_wait_cycles":165504,"thread_start_us":129,"threads_started":1}
I20260811 07:32:22.244740 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.239574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:45641 (local address 127.22.4.193:36029)
0811 07:32:22.239988 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.240000 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.240016 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:32:22.240069 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.240071 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.240129 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.240672 (+ 543us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.240768 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.241482 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.243093 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.243882 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.244028 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.244090 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.244436 (+ 346us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.244539 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":147,"threads_started":1}
I20260811 07:32:22.245028 26123 raft_consensus.cc:504] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.245582 25547 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a016a76ad87540359d13fb26015ffb06" candidate_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2435350735ba49d3a8cbc2a2eec7b987" is_pre_election: true
I20260811 07:32:22.245796 25547 raft_consensus.cc:2454] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba2a5ba9fd614b6ca3e91628f81b44a3 in term 0.
I20260811 07:32:22.245981 26123 leader_election.cc:288] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [CANDIDATE]: Term 1 election: Requested vote from peers 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029), ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461)
I20260811 07:32:22.246068 25784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a016a76ad87540359d13fb26015ffb06" candidate_uuid: "cc3d2903e89b4f93a10eec69fa568dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3"
I20260811 07:32:22.246058 25563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a016a76ad87540359d13fb26015ffb06" candidate_uuid: "cc3d2903e89b4f93a10eec69fa568dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2435350735ba49d3a8cbc2a2eec7b987"
I20260811 07:32:22.246230 25784 raft_consensus.cc:3037] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.246213 25563 raft_consensus.cc:3037] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.246371 25673 leader_election.cc:302] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, ba2a5ba9fd614b6ca3e91628f81b44a3; no voters:
I20260811 07:32:22.246731 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.239667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:45609 (local address 127.22.4.195:33139)
0811 07:32:22.239800 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.239805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.240034 (+ 229us) server_negotiation.cc:407] Connection header received
0811 07:32:22.240758 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.240765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.240840 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.240904 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.241688 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.242534 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.244375 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.245259 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.245397 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.245480 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.246427 (+ 947us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.246547 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 07:32:22.247247 26128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.239207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:33139 (local address 127.22.4.194:45609)
0811 07:32:22.239929 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.239947 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.240588 (+ 641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.241340 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.241344 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.241368 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.241533 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.241541 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.242741 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.242744 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.244225 (+ 1481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.244236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.245569 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.245573 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.245719 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.246269 (+ 550us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.246920 (+ 651us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.247045 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":1,"spinlock_wait_cycles":41216,"thread_start_us":81,"threads_started":1}
I20260811 07:32:22.247887 25784 raft_consensus.cc:2454] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc3d2903e89b4f93a10eec69fa568dad in term 1.
I20260811 07:32:22.248085 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a016a76ad87540359d13fb26015ffb06" candidate_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc3d2903e89b4f93a10eec69fa568dad" is_pre_election: true
I20260811 07:32:22.248363 25563 raft_consensus.cc:2454] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc3d2903e89b4f93a10eec69fa568dad in term 1.
I20260811 07:32:22.248382 26001 raft_consensus.cc:2379] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ba2a5ba9fd614b6ca3e91628f81b44a3 in current term 1: Already voted for candidate cc3d2903e89b4f93a10eec69fa568dad in this term.
I20260811 07:32:22.248759 25890 leader_election.cc:302] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, cc3d2903e89b4f93a10eec69fa568dad; no voters:
I20260811 07:32:22.248840 26117 raft_consensus.cc:2741] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260811 07:32:22.248941 26123 raft_consensus.cc:2781] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:22.249256 26123 raft_consensus.cc:686] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 1 LEADER]: Becoming Leader. State: Replica: cc3d2903e89b4f93a10eec69fa568dad, State: Running, Role: LEADER
I20260811 07:32:22.249616 26123 consensus_queue.cc:237] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
W20260811 07:32:22.251439 26069 tablet.cc:2369] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:22.254040 25303 catalog_manager.cc:5495] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad reported cstate change: term changed from 0 to 1, leader changed from <none> to cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195). New cstate: current_term: 1 leader_uuid: "cc3d2903e89b4f93a10eec69fa568dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } health_report { overall_health: HEALTHY } } }
Aug 11 07:32:22 dist-test-slave-7z32 krb5kdc[25237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433540, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:22.309167 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.297915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34603 (local address 127.0.0.1:50190)
0811 07:32:22.298398 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.298415 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.298624 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.298978 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.298981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.299661 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:22.299771 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.299778 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.300643 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.300648 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.301248 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.301256 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.301821 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.301824 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.301897 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.302713 (+ 816us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:22.302732 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:22.304524 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:22.306858 (+ 2334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:22.306878 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:22.306890 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:22.307221 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:22.307584 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:22.307591 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:22.307596 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:22.307694 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:22.308199 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:22.308212 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:22.308499 (+ 287us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.308679 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.309027 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":114,"thread_start_us":174,"threads_started":1}
I20260811 07:32:22.309167 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.297978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50190 (local address 127.22.4.254:34603)
0811 07:32:22.298248 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.298267 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.298531 (+ 264us) server_negotiation.cc:407] Connection header received
0811 07:32:22.298744 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.298756 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.298799 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.298954 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:22.299908 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.300521 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.301431 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.301693 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.301806 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.304729 (+ 2923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:22.304735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:22.304743 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:22.304766 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:22.306594 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:22.307348 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:22.307355 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:22.307357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:22.307452 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:22.307808 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:22.307814 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:22.307816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:22.308068 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:22.308196 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.308747 (+ 551us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.308939 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 07:32:22.316229 25303 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:50190:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:32:22.317705 25303 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:22.324854 25530 tablet_service.cc:1467] Processing CreateTablet for tablet 60aac07b24504bf4af7b09327b8923f0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b8f0d54e713e4dd1a0ef21ef732e66db]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:32:22.324856 25967 tablet_service.cc:1467] Processing CreateTablet for tablet 60aac07b24504bf4af7b09327b8923f0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b8f0d54e713e4dd1a0ef21ef732e66db]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:32:22.325961 25530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60aac07b24504bf4af7b09327b8923f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.325961 25967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60aac07b24504bf4af7b09327b8923f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.327486 25751 tablet_service.cc:1467] Processing CreateTablet for tablet 60aac07b24504bf4af7b09327b8923f0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b8f0d54e713e4dd1a0ef21ef732e66db]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:32:22.328480 25751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60aac07b24504bf4af7b09327b8923f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.330127 26111 tablet_bootstrap.cc:492] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: Bootstrap starting.
I20260811 07:32:22.331034 26109 tablet_bootstrap.cc:492] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: Bootstrap starting.
I20260811 07:32:22.331456 26111 tablet_bootstrap.cc:654] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.331974 26107 tablet_bootstrap.cc:492] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: Bootstrap starting.
I20260811 07:32:22.332404 26109 tablet_bootstrap.cc:654] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.333374 26111 tablet_bootstrap.cc:492] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: No bootstrap required, opened a new log
I20260811 07:32:22.333492 26111 ts_tablet_manager.cc:1397] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:32:22.333623 26107 tablet_bootstrap.cc:654] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.334133 26109 tablet_bootstrap.cc:492] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: No bootstrap required, opened a new log
I20260811 07:32:22.334257 26109 ts_tablet_manager.cc:1397] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:22.334368 26111 raft_consensus.cc:348] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.334550 26111 raft_consensus.cc:374] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.334607 26111 raft_consensus.cc:729] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2435350735ba49d3a8cbc2a2eec7b987, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.334810 26111 consensus_queue.cc:260] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.334914 26109 raft_consensus.cc:348] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.335074 26109 raft_consensus.cc:374] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.335112 26109 raft_consensus.cc:729] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc3d2903e89b4f93a10eec69fa568dad, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.335299 26107 tablet_bootstrap.cc:492] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: No bootstrap required, opened a new log
I20260811 07:32:22.335259 26109 consensus_queue.cc:260] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.335186 26122 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.335386 26107 ts_tablet_manager.cc:1397] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s
I20260811 07:32:22.335390 26122 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:22.335194 26111 ts_tablet_manager.cc:1428] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:32:22.335594 26109 ts_tablet_manager.cc:1428] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:32:22.335964 26107 raft_consensus.cc:348] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.336103 26107 raft_consensus.cc:374] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.336138 26107 raft_consensus.cc:729] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2a5ba9fd614b6ca3e91628f81b44a3, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.336275 26123 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.336490 26123 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:22.336874 26107 consensus_queue.cc:260] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.337291 26107 ts_tablet_manager.cc:1428] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260811 07:32:22.337321 26117 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.337502 26117 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:22.517015 26122 raft_consensus.cc:482] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:22.517201 26122 raft_consensus.cc:504] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.518639 26122 leader_election.cc:288] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461), cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139)
I20260811 07:32:22.525045 26148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.519203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:38461 (local address 127.22.4.193:46557)
0811 07:32:22.519698 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.519715 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.519956 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.520355 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.520360 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.520398 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.520569 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.520581 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.521554 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.521557 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.523094 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.523108 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.524374 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.524380 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.524575 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.524612 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.524707 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.524855 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":189,"spinlock_wait_cycles":30208,"thread_start_us":208,"threads_started":1}
I20260811 07:32:22.525163 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.519332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:39273 (local address 127.22.4.195:33139)
0811 07:32:22.519506 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.519513 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.519904 (+ 391us) server_negotiation.cc:407] Connection header received
0811 07:32:22.520138 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.520141 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.520191 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.520293 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.520705 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.521319 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.523320 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.524166 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.524343 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.524422 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.524774 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.524916 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:32:22.525041 26149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.519110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:33139 (local address 127.22.4.193:39273)
0811 07:32:22.519698 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.519715 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.519906 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.520314 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.520317 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.520337 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:22.520526 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.520534 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.521441 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.521448 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.523094 (+ 1646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.523108 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.524399 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.524402 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.524599 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.524618 (+ 19us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.524707 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.524828 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":165,"spinlock_wait_cycles":30336,"thread_start_us":186,"threads_started":1}
I20260811 07:32:22.526072 26102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.519346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:46557 (local address 127.22.4.194:38461)
0811 07:32:22.519562 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.519568 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.519967 (+ 399us) server_negotiation.cc:407] Connection header received
0811 07:32:22.520114 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.520119 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.520195 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.520333 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:22.520768 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.521423 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.523320 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.524147 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.524343 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.524422 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.525735 (+ 1313us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.525868 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:32:22.526057 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60aac07b24504bf4af7b09327b8923f0" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc3d2903e89b4f93a10eec69fa568dad" is_pre_election: true
I20260811 07:32:22.526291 26001 raft_consensus.cc:2454] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 0.
I20260811 07:32:22.526602 25784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60aac07b24504bf4af7b09327b8923f0" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" is_pre_election: true
I20260811 07:32:22.526767 25458 leader_election.cc:302] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, cc3d2903e89b4f93a10eec69fa568dad; no voters:
I20260811 07:32:22.526841 25784 raft_consensus.cc:2454] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 0.
I20260811 07:32:22.527275 26122 raft_consensus.cc:2781] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:22.527513 26122 raft_consensus.cc:482] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:22.527695 26122 raft_consensus.cc:3037] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.529460 26122 raft_consensus.cc:504] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.530068 26122 leader_election.cc:288] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 election: Requested vote from peers ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461), cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139)
I20260811 07:32:22.530894 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60aac07b24504bf4af7b09327b8923f0" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc3d2903e89b4f93a10eec69fa568dad"
I20260811 07:32:22.531069 26001 raft_consensus.cc:3037] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.531052 25784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60aac07b24504bf4af7b09327b8923f0" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3"
I20260811 07:32:22.531245 25784 raft_consensus.cc:3037] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.532480 26001 raft_consensus.cc:2454] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 1.
I20260811 07:32:22.532612 25784 raft_consensus.cc:2454] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 1.
I20260811 07:32:22.532959 25458 leader_election.cc:302] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, cc3d2903e89b4f93a10eec69fa568dad; no voters:
I20260811 07:32:22.533731 26122 raft_consensus.cc:2781] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:22.534080 26122 raft_consensus.cc:686] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 LEADER]: Becoming Leader. State: Replica: 2435350735ba49d3a8cbc2a2eec7b987, State: Running, Role: LEADER
I20260811 07:32:22.534642 26122 consensus_queue.cc:237] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.538856 26150 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: TxnStatusTablet state changed. Reason: New leader 2435350735ba49d3a8cbc2a2eec7b987. Latest consensus state: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.539024 26150 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:32:22.539851 26154 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:32:22.540107 26154 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:32:22.545502 25303 catalog_manager.cc:5495] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:22.588582 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.583746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35430 (local address 127.22.4.193:36029)
0811 07:32:22.583901 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.583907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.583924 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:32:22.584222 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.584225 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.584286 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.584493 (+ 207us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:22.584836 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.585539 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.586611 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.586936 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.587084 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.587486 (+ 402us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.588044 (+ 558us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.588197 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.588336 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.588412 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:32:22.588584 26141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.583586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36029 (local address 127.0.0.1:35430)
0811 07:32:22.583798 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.583819 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.584016 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.584494 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.584498 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.584515 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:32:22.584663 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.584670 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.585706 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.585710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.586454 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.586465 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.587097 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.587101 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.587222 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.587291 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.588184 (+ 893us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.588205 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.588317 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.588443 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260811 07:32:22.595216 26001 raft_consensus.cc:1261] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Refusing update from remote peer 2435350735ba49d3a8cbc2a2eec7b987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:22.595652 25784 raft_consensus.cc:1261] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Refusing update from remote peer 2435350735ba49d3a8cbc2a2eec7b987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:22.595979 26122 consensus_queue.cc:1035] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:22.596576 26150 consensus_queue.cc:1035] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:22.600217 26123 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: TxnStatusTablet state changed. Reason: New leader 2435350735ba49d3a8cbc2a2eec7b987. Latest consensus state: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.600382 26123 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:22.600997 26117 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: TxnStatusTablet state changed. Reason: New leader 2435350735ba49d3a8cbc2a2eec7b987. Latest consensus state: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.601142 26117 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:22.604296 26150 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.604444 26150 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:32:22.605163 26158 mvcc.cc:205] Tried to move back new op lower bound from 7317231790461665280 to 7317231790228058112. Current Snapshot: MvccSnapshot[applied={T|T < 7317231790461665280}]
I20260811 07:32:22.605477 26122 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.605638 26122 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P 2435350735ba49d3a8cbc2a2eec7b987: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:32:22.606487 26123 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.606654 26123 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P cc3d2903e89b4f93a10eec69fa568dad: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:22.607652 26117 tablet_replica.cc:439] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } } }
I20260811 07:32:22.607816 26117 tablet_replica.cc:442] T 60aac07b24504bf4af7b09327b8923f0 P ba2a5ba9fd614b6ca3e91628f81b44a3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:32:22.609408 26160 mvcc.cc:205] Tried to move back new op lower bound from 7317231790461665280 to 7317231790228058112. Current Snapshot: MvccSnapshot[applied={T|T < 7317231790461665280}]
I20260811 07:32:22.618407 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.614184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53664 (local address 127.22.4.195:33139)
0811 07:32:22.614311 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.614317 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.614582 (+ 265us) server_negotiation.cc:407] Connection header received
0811 07:32:22.614852 (+ 270us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.614855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.614949 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.615069 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:22.615341 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.615866 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.616752 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.616984 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.617098 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.617467 (+ 369us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.617941 (+ 474us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.618077 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.618147 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.618204 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:32:22.634724 26175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.629573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36029 (local address 127.22.4.195:44509)
0811 07:32:22.629976 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.629991 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.630110 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.630569 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.630572 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.630580 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:32:22.630727 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.630732 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.632265 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.632268 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.632937 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.632948 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.633674 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.633677 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.633765 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.633833 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.634339 (+ 506us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.634347 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.634466 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.634552 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":142,"threads_started":1}
I20260811 07:32:22.634963 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.629741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:44509 (local address 127.22.4.193:36029)
0811 07:32:22.629924 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.629929 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.630092 (+ 163us) server_negotiation.cc:407] Connection header received
0811 07:32:22.630299 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.630303 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.630380 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.630506 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:22.631004 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.631971 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.633111 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.633493 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.633633 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.634048 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.634171 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.634277 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.634499 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.634584 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:32:22.644636 25784 raft_consensus.cc:1261] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Refusing update from remote peer cc3d2903e89b4f93a10eec69fa568dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:22.644711 25563 raft_consensus.cc:1261] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Refusing update from remote peer cc3d2903e89b4f93a10eec69fa568dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:22.645370 26132 consensus_queue.cc:1035] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:22.645609 26123 consensus_queue.cc:1035] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:22.649084 26159 mvcc.cc:205] Tried to move back new op lower bound from 7317231790666018816 to 7317231789057867776. Current Snapshot: MvccSnapshot[applied={T|T < 7317231790666018816}]
I20260811 07:32:22.677310 26104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.671879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:47193 (local address 127.22.4.195:33139)
0811 07:32:22.672112 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.672118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.672340 (+ 222us) server_negotiation.cc:407] Connection header received
0811 07:32:22.672545 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.672549 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.672624 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.672726 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:22.673122 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.673996 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.675859 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.676104 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.676271 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.676708 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.676833 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.676940 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.677084 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.677146 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:32:22.677413 26185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.671803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:33139 (local address 127.22.4.193:47193)
0811 07:32:22.672214 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.672229 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.672394 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.672750 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.672753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.672770 (+ 17us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:32:22.672937 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.672943 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.674320 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.674325 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.675643 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.675665 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.676291 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.676295 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.676423 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.676522 (+ 99us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.676961 (+ 439us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.676973 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.677071 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.677209 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":109,"threads_started":1}
I20260811 07:32:22.732324 25303 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:22.732616 25303 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:22.736544 25303 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: Sending DeleteTablet for 3 replicas of tablet a016a76ad87540359d13fb26015ffb06
I20260811 07:32:22.737881 25967 tablet_service.cc:1514] Processing DeleteTablet for tablet a016a76ad87540359d13fb26015ffb06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:22 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:53658
I20260811 07:32:22.738085 25751 tablet_service.cc:1514] Processing DeleteTablet for tablet a016a76ad87540359d13fb26015ffb06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:22 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:38756
I20260811 07:32:22.738689 26188 tablet_replica.cc:330] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: stopping tablet replica
I20260811 07:32:22.739197 26188 raft_consensus.cc:2229] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:22.739142 25530 tablet_service.cc:1514] Processing DeleteTablet for tablet a016a76ad87540359d13fb26015ffb06 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:22 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:35416
I20260811 07:32:22.739671 26188 raft_consensus.cc:2258] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:22.740403 26190 tablet_replica.cc:330] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: stopping tablet replica
I20260811 07:32:22.740394 25303 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50186:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:22.741003 25303 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:22.741026 26190 raft_consensus.cc:2229] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:22.741415 26190 raft_consensus.cc:2258] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:22.743202 26190 ts_tablet_manager.cc:1905] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:22.746693 26190 ts_tablet_manager.cc:1918] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:22.746904 26190 log.cc:1196] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/a016a76ad87540359d13fb26015ffb06
I20260811 07:32:22.747352 26190 ts_tablet_manager.cc:1939] T a016a76ad87540359d13fb26015ffb06 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting consensus metadata
I20260811 07:32:22.747824 26192 tablet_replica.cc:330] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: stopping tablet replica
I20260811 07:32:22.748255 26192 raft_consensus.cc:2229] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:22.748483 26192 raft_consensus.cc:2258] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:22.749732 25530 tablet_service.cc:1467] Processing CreateTablet for tablet 8cc4e7ea41b3453994bebead01b7b0d7 (DEFAULT_TABLE table=test-table [id=f85362d87e474e9d8f4009ce48235685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:22.750079 26192 ts_tablet_manager.cc:1905] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:22.750126 25530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cc4e7ea41b3453994bebead01b7b0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.750620 25967 tablet_service.cc:1467] Processing CreateTablet for tablet 8cc4e7ea41b3453994bebead01b7b0d7 (DEFAULT_TABLE table=test-table [id=f85362d87e474e9d8f4009ce48235685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:22.751025 25967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cc4e7ea41b3453994bebead01b7b0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.753614 26111 tablet_bootstrap.cc:492] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: Bootstrap starting.
I20260811 07:32:22.753878 25283 catalog_manager.cc:4841] TS ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461): tablet a016a76ad87540359d13fb26015ffb06 (table test-table [id=a89c360fb3c1428fae97425c3dc2c079]) successfully deleted
I20260811 07:32:22.754617 26111 tablet_bootstrap.cc:654] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.754693 25751 tablet_service.cc:1467] Processing CreateTablet for tablet 8cc4e7ea41b3453994bebead01b7b0d7 (DEFAULT_TABLE table=test-table [id=f85362d87e474e9d8f4009ce48235685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:22.755086 25751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8cc4e7ea41b3453994bebead01b7b0d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:22.755080 26109 tablet_bootstrap.cc:492] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: Bootstrap starting.
I20260811 07:32:22.756229 26109 tablet_bootstrap.cc:654] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.756918 26111 tablet_bootstrap.cc:492] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: No bootstrap required, opened a new log
I20260811 07:32:22.757035 26111 ts_tablet_manager.cc:1397] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:22.757573 26111 raft_consensus.cc:348] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.757738 26111 raft_consensus.cc:374] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.757797 26111 raft_consensus.cc:729] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2435350735ba49d3a8cbc2a2eec7b987, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.757961 26111 consensus_queue.cc:260] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.758363 26111 ts_tablet_manager.cc:1428] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:32:22.759136 26107 tablet_bootstrap.cc:492] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: Bootstrap starting.
I20260811 07:32:22.760321 26188 ts_tablet_manager.cc:1905] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:22.760365 26107 tablet_bootstrap.cc:654] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:22.762159 26107 tablet_bootstrap.cc:492] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: No bootstrap required, opened a new log
I20260811 07:32:22.762279 26107 ts_tablet_manager.cc:1397] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 07:32:22.762807 26107 raft_consensus.cc:348] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.762996 26107 raft_consensus.cc:374] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.763036 26107 raft_consensus.cc:729] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2a5ba9fd614b6ca3e91628f81b44a3, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.763386 26107 consensus_queue.cc:260] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.764286 26107 ts_tablet_manager.cc:1428] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:32:22.766453 26192 ts_tablet_manager.cc:1918] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:22.766598 26192 log.cc:1196] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/a016a76ad87540359d13fb26015ffb06
I20260811 07:32:22.767037 26192 ts_tablet_manager.cc:1939] T a016a76ad87540359d13fb26015ffb06 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting consensus metadata
I20260811 07:32:22.767194 26188 ts_tablet_manager.cc:1918] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:22.767304 26188 log.cc:1196] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/a016a76ad87540359d13fb26015ffb06
I20260811 07:32:22.767625 26188 ts_tablet_manager.cc:1939] T a016a76ad87540359d13fb26015ffb06 P cc3d2903e89b4f93a10eec69fa568dad: Deleting consensus metadata
I20260811 07:32:22.768628 25281 catalog_manager.cc:4841] TS 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029): tablet a016a76ad87540359d13fb26015ffb06 (table test-table [id=a89c360fb3c1428fae97425c3dc2c079]) successfully deleted
I20260811 07:32:22.769029 25281 catalog_manager.cc:4841] TS cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139): tablet a016a76ad87540359d13fb26015ffb06 (table test-table [id=a89c360fb3c1428fae97425c3dc2c079]) successfully deleted
I20260811 07:32:22.769603 26109 tablet_bootstrap.cc:492] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: No bootstrap required, opened a new log
I20260811 07:32:22.769711 26109 ts_tablet_manager.cc:1397] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.000s
I20260811 07:32:22.770205 26109 raft_consensus.cc:348] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.770358 26109 raft_consensus.cc:374] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:22.770395 26109 raft_consensus.cc:729] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc3d2903e89b4f93a10eec69fa568dad, State: Initialized, Role: FOLLOWER
I20260811 07:32:22.770550 26109 consensus_queue.cc:260] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.770816 26109 ts_tablet_manager.cc:1428] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:32:22.907516 26122 raft_consensus.cc:482] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:22.907816 26122 raft_consensus.cc:504] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.908438 26122 leader_election.cc:288] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461), cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139)
I20260811 07:32:22.909143 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cc4e7ea41b3453994bebead01b7b0d7" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc3d2903e89b4f93a10eec69fa568dad" is_pre_election: true
I20260811 07:32:22.909188 25784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cc4e7ea41b3453994bebead01b7b0d7" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" is_pre_election: true
I20260811 07:32:22.909363 26001 raft_consensus.cc:2454] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 0.
I20260811 07:32:22.909436 25784 raft_consensus.cc:2454] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 0.
I20260811 07:32:22.909812 25458 leader_election.cc:302] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, cc3d2903e89b4f93a10eec69fa568dad; no voters:
I20260811 07:32:22.910274 26122 raft_consensus.cc:2781] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:22.910373 26122 raft_consensus.cc:482] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:22.910432 26122 raft_consensus.cc:3037] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.912025 26122 raft_consensus.cc:504] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.912482 26122 leader_election.cc:288] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 election: Requested vote from peers ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461), cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139)
I20260811 07:32:22.913010 25784 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cc4e7ea41b3453994bebead01b7b0d7" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3"
I20260811 07:32:22.913187 25784 raft_consensus.cc:3037] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.913259 26001 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8cc4e7ea41b3453994bebead01b7b0d7" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc3d2903e89b4f93a10eec69fa568dad"
I20260811 07:32:22.913395 26001 raft_consensus.cc:3037] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:22.914675 25784 raft_consensus.cc:2454] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 1.
I20260811 07:32:22.914783 26001 raft_consensus.cc:2454] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 1.
I20260811 07:32:22.915196 25461 leader_election.cc:302] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, ba2a5ba9fd614b6ca3e91628f81b44a3; no voters:
I20260811 07:32:22.915423 26122 raft_consensus.cc:2781] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:22.915527 26122 raft_consensus.cc:686] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 LEADER]: Becoming Leader. State: Replica: 2435350735ba49d3a8cbc2a2eec7b987, State: Running, Role: LEADER
I20260811 07:32:22.915746 26122 consensus_queue.cc:237] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:22.918229 25303 catalog_manager.cc:5495] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:22.941082 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.937264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35440 (local address 127.22.4.193:36029)
0811 07:32:22.937469 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.937473 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.937590 (+ 117us) server_negotiation.cc:407] Connection header received
0811 07:32:22.937727 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.937730 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.937792 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.937876 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:22.938164 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.938799 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.939780 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.940002 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.940091 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.940481 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.940569 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.940638 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.940858 (+ 220us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.940926 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260811 07:32:22.953892 26185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.949766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36029 (local address 127.22.4.193:35797)
0811 07:32:22.949996 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:22.950021 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:22.950113 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:22.950439 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:22.950442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:22.950450 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:32:22.950558 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.950563 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.951700 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.951703 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.952389 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:22.952400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.953040 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.953043 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:22.953127 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.953168 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.953562 (+ 394us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.953569 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 07:32:22.953649 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 07:32:22.953737 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260811 07:32:22.954062 26130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:22.949943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:35797 (local address 127.22.4.193:36029)
0811 07:32:22.950099 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:22.950103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:22.950120 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:32:22.950234 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:22.950236 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:22.950290 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:22.950378 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:22.950753 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.951545 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.952621 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:22.952854 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:22.952959 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:22.953334 (+ 375us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:22.953432 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:22.953510 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:22.953753 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 07:32:22.953822 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:32:22.961954 25784 raft_consensus.cc:1261] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Refusing update from remote peer 2435350735ba49d3a8cbc2a2eec7b987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:22.962046 26001 raft_consensus.cc:1261] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Refusing update from remote peer 2435350735ba49d3a8cbc2a2eec7b987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:22.962596 26202 consensus_queue.cc:1035] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:22.962977 26122 consensus_queue.cc:1035] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:32:22.980953 26158 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 07:32:24.578517 25303 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:24.578786 25303 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50186:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:24.583374 25303 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: Sending DeleteTablet for 3 replicas of tablet 8cc4e7ea41b3453994bebead01b7b0d7
I20260811 07:32:24.584640 25751 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cc4e7ea41b3453994bebead01b7b0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:24 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:38756
I20260811 07:32:24.584796 25530 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cc4e7ea41b3453994bebead01b7b0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:24 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:35416
I20260811 07:32:24.584802 25967 tablet_service.cc:1514] Processing DeleteTablet for tablet 8cc4e7ea41b3453994bebead01b7b0d7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:24 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:53658
I20260811 07:32:24.585285 26237 tablet_replica.cc:330] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: stopping tablet replica
I20260811 07:32:24.585467 26237 raft_consensus.cc:2229] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:24.585654 26237 raft_consensus.cc:2258] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:24.585680 26236 tablet_replica.cc:330] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: stopping tablet replica
I20260811 07:32:24.586004 26236 raft_consensus.cc:2229] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:24.586230 26236 raft_consensus.cc:2258] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:24.586553 26237 ts_tablet_manager.cc:1905] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:24.587414 26236 ts_tablet_manager.cc:1905] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:24.590342 26238 tablet_replica.cc:330] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: stopping tablet replica
I20260811 07:32:24.590591 26238 raft_consensus.cc:2229] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:24.591310 26238 raft_consensus.cc:2258] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:24.592233 26237 ts_tablet_manager.cc:1918] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:32:24.592379 26237 log.cc:1196] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/8cc4e7ea41b3453994bebead01b7b0d7
I20260811 07:32:24.592368 26238 ts_tablet_manager.cc:1905] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:24.592556 26236 ts_tablet_manager.cc:1918] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:32:24.592741 26236 log.cc:1196] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/8cc4e7ea41b3453994bebead01b7b0d7
I20260811 07:32:24.592746 26237 ts_tablet_manager.cc:1939] T 8cc4e7ea41b3453994bebead01b7b0d7 P cc3d2903e89b4f93a10eec69fa568dad: Deleting consensus metadata
I20260811 07:32:24.593204 26236 ts_tablet_manager.cc:1939] T 8cc4e7ea41b3453994bebead01b7b0d7 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting consensus metadata
I20260811 07:32:24.593986 25281 catalog_manager.cc:4841] TS cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139): tablet 8cc4e7ea41b3453994bebead01b7b0d7 (table test-table [id=f85362d87e474e9d8f4009ce48235685]) successfully deleted
I20260811 07:32:24.594739 25283 catalog_manager.cc:4841] TS ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461): tablet 8cc4e7ea41b3453994bebead01b7b0d7 (table test-table [id=f85362d87e474e9d8f4009ce48235685]) successfully deleted
I20260811 07:32:24.596422 26238 ts_tablet_manager.cc:1918] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:32:24.596580 26238 log.cc:1196] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/8cc4e7ea41b3453994bebead01b7b0d7
I20260811 07:32:24.596963 26238 ts_tablet_manager.cc:1939] T 8cc4e7ea41b3453994bebead01b7b0d7 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting consensus metadata
I20260811 07:32:24.598448 25281 catalog_manager.cc:4841] TS 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029): tablet 8cc4e7ea41b3453994bebead01b7b0d7 (table test-table [id=f85362d87e474e9d8f4009ce48235685]) successfully deleted
Aug 11 07:32:24 dist-test-slave-7z32 krb5kdc[25237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:32:24 dist-test-slave-7z32 krb5kdc[25237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433544, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:24.632874 26251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:24.619042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50200 (local address 127.22.4.254:34603)
0811 07:32:24.619502 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:24.619511 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:24.619532 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:32:24.619603 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:24.619606 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:24.619663 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:24.619840 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:24.621016 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:24.621816 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:24.623332 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:24.623622 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:24.623745 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:24.627468 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:24.627473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:24.627475 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:24.627525 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:24.629533 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:24.630672 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:24.630677 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:24.630679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:24.630902 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:24.631419 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:24.631422 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:24.631424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:24.631866 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:24.632034 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:24.632432 (+ 398us) server_negotiation.cc:299] Negotiation successful
0811 07:32:24.632641 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":216,"threads_started":1}
I20260811 07:32:24.638132 25303 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:24.638917 25303 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:24.647187 25530 tablet_service.cc:1467] Processing CreateTablet for tablet c4d8903d57ea42188e215afce2bde654 (DEFAULT_TABLE table=test-table [id=41dcfa189e254358bf4219258387671e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:24.647244 25967 tablet_service.cc:1467] Processing CreateTablet for tablet c4d8903d57ea42188e215afce2bde654 (DEFAULT_TABLE table=test-table [id=41dcfa189e254358bf4219258387671e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:24.647307 25751 tablet_service.cc:1467] Processing CreateTablet for tablet c4d8903d57ea42188e215afce2bde654 (DEFAULT_TABLE table=test-table [id=41dcfa189e254358bf4219258387671e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:24.647619 25530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d8903d57ea42188e215afce2bde654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:24.647619 25967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d8903d57ea42188e215afce2bde654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:24.647787 25751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4d8903d57ea42188e215afce2bde654. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:24.652320 26252 tablet_bootstrap.cc:492] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: Bootstrap starting.
I20260811 07:32:24.652578 26256 tablet_bootstrap.cc:492] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: Bootstrap starting.
I20260811 07:32:24.653087 26255 tablet_bootstrap.cc:492] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: Bootstrap starting.
I20260811 07:32:24.653887 26256 tablet_bootstrap.cc:654] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:24.654426 26255 tablet_bootstrap.cc:654] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:24.655133 26252 tablet_bootstrap.cc:654] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:24.655845 26256 tablet_bootstrap.cc:492] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: No bootstrap required, opened a new log
I20260811 07:32:24.655975 26256 ts_tablet_manager.cc:1397] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:24.656109 26255 tablet_bootstrap.cc:492] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: No bootstrap required, opened a new log
I20260811 07:32:24.656208 26255 ts_tablet_manager.cc:1397] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:24.656540 26256 raft_consensus.cc:348] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.656723 26256 raft_consensus.cc:374] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:24.656759 26256 raft_consensus.cc:729] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc3d2903e89b4f93a10eec69fa568dad, State: Initialized, Role: FOLLOWER
I20260811 07:32:24.656647 26255 raft_consensus.cc:348] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.656811 26255 raft_consensus.cc:374] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:24.656847 26255 raft_consensus.cc:729] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2435350735ba49d3a8cbc2a2eec7b987, State: Initialized, Role: FOLLOWER
I20260811 07:32:24.656920 26256 consensus_queue.cc:260] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.657060 26255 consensus_queue.cc:260] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.657270 26252 tablet_bootstrap.cc:492] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: No bootstrap required, opened a new log
I20260811 07:32:24.657421 26252 ts_tablet_manager.cc:1397] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260811 07:32:24.657459 26256 ts_tablet_manager.cc:1428] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:32:24.658056 26252 raft_consensus.cc:348] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.658224 26252 raft_consensus.cc:374] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:24.658288 26252 raft_consensus.cc:729] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2a5ba9fd614b6ca3e91628f81b44a3, State: Initialized, Role: FOLLOWER
I20260811 07:32:24.658448 26252 consensus_queue.cc:260] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.658531 26255 ts_tablet_manager.cc:1428] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:32:24.658993 26252 ts_tablet_manager.cc:1428] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 07:32:24.962678 26264 raft_consensus.cc:482] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:24.962972 26264 raft_consensus.cc:504] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.963603 26264 leader_election.cc:288] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029), ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461)
I20260811 07:32:24.964164 25563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4d8903d57ea42188e215afce2bde654" candidate_uuid: "cc3d2903e89b4f93a10eec69fa568dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2435350735ba49d3a8cbc2a2eec7b987" is_pre_election: true
I20260811 07:32:24.964354 25563 raft_consensus.cc:2454] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc3d2903e89b4f93a10eec69fa568dad in term 0.
I20260811 07:32:24.964542 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4d8903d57ea42188e215afce2bde654" candidate_uuid: "cc3d2903e89b4f93a10eec69fa568dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" is_pre_election: true
I20260811 07:32:24.964809 25782 raft_consensus.cc:2454] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc3d2903e89b4f93a10eec69fa568dad in term 0.
I20260811 07:32:24.964823 25890 leader_election.cc:302] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, cc3d2903e89b4f93a10eec69fa568dad; no voters:
I20260811 07:32:24.965087 26264 raft_consensus.cc:2781] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:24.965181 26264 raft_consensus.cc:482] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:24.965229 26264 raft_consensus.cc:3037] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:24.966491 26264 raft_consensus.cc:504] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.966990 26264 leader_election.cc:288] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [CANDIDATE]: Term 1 election: Requested vote from peers 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029), ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461)
I20260811 07:32:24.967644 25563 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4d8903d57ea42188e215afce2bde654" candidate_uuid: "cc3d2903e89b4f93a10eec69fa568dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2435350735ba49d3a8cbc2a2eec7b987"
I20260811 07:32:24.967602 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4d8903d57ea42188e215afce2bde654" candidate_uuid: "cc3d2903e89b4f93a10eec69fa568dad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3"
I20260811 07:32:24.967803 25563 raft_consensus.cc:3037] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:24.967849 25782 raft_consensus.cc:3037] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:24.968920 25563 raft_consensus.cc:2454] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc3d2903e89b4f93a10eec69fa568dad in term 1.
I20260811 07:32:24.969321 25782 raft_consensus.cc:2454] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc3d2903e89b4f93a10eec69fa568dad in term 1.
I20260811 07:32:24.969341 25890 leader_election.cc:302] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, cc3d2903e89b4f93a10eec69fa568dad; no voters:
I20260811 07:32:24.969559 26264 raft_consensus.cc:2781] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:24.969861 26264 raft_consensus.cc:686] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 1 LEADER]: Becoming Leader. State: Replica: cc3d2903e89b4f93a10eec69fa568dad, State: Running, Role: LEADER
I20260811 07:32:24.970059 26264 consensus_queue.cc:237] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:24.972054 25303 catalog_manager.cc:5495] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad reported cstate change: term changed from 0 to 1, leader changed from <none> to cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195). New cstate: current_term: 1 leader_uuid: "cc3d2903e89b4f93a10eec69fa568dad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } health_report { overall_health: HEALTHY } } }
I20260811 07:32:25.039240 26270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:25.035221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53666 (local address 127.22.4.195:33139)
0811 07:32:25.035578 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:25.035586 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:25.035601 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:32:25.035659 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:25.035661 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:25.035716 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:25.035805 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:25.036104 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:25.036760 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:25.037713 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:25.037948 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:25.038034 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:25.038541 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:25.038649 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:25.038755 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:25.038958 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 07:32:25.039039 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":176,"threads_started":1}
I20260811 07:32:25.048540 25563 raft_consensus.cc:1261] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Refusing update from remote peer cc3d2903e89b4f93a10eec69fa568dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:25.048620 25782 raft_consensus.cc:1261] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Refusing update from remote peer cc3d2903e89b4f93a10eec69fa568dad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:25.049098 26264 consensus_queue.cc:1035] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:25.049300 26266 consensus_queue.cc:1035] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [LEADER]: Connected to new peer: Peer: permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:25.099953 25303 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:25.100173 25303 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:25.103530 25303 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: Sending DeleteTablet for 3 replicas of tablet c4d8903d57ea42188e215afce2bde654
I20260811 07:32:25.104704 25530 tablet_service.cc:1514] Processing DeleteTablet for tablet c4d8903d57ea42188e215afce2bde654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:25 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:35416
I20260811 07:32:25.104704 25751 tablet_service.cc:1514] Processing DeleteTablet for tablet c4d8903d57ea42188e215afce2bde654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:25 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:38756
I20260811 07:32:25.105082 25967 tablet_service.cc:1514] Processing DeleteTablet for tablet c4d8903d57ea42188e215afce2bde654 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:25 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:53658
I20260811 07:32:25.105130 26278 tablet_replica.cc:330] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: stopping tablet replica
I20260811 07:32:25.105300 26278 raft_consensus.cc:2229] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:25.105345 26280 tablet_replica.cc:330] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: stopping tablet replica
I20260811 07:32:25.105407 26282 tablet_replica.cc:330] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: stopping tablet replica
I20260811 07:32:25.105463 26278 raft_consensus.cc:2258] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:25.105552 26282 raft_consensus.cc:2229] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:25.105782 26282 raft_consensus.cc:2258] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:25.105576 26280 raft_consensus.cc:2229] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:25.105996 26280 raft_consensus.cc:2258] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:25.105954 25303 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:25.106618 25303 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:25.107055 26280 ts_tablet_manager.cc:1905] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:25.108255 26282 ts_tablet_manager.cc:1905] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:25.108918 26278 ts_tablet_manager.cc:1905] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:25.112372 26280 ts_tablet_manager.cc:1918] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:25.112496 26280 log.cc:1196] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/c4d8903d57ea42188e215afce2bde654
I20260811 07:32:25.113258 26280 ts_tablet_manager.cc:1939] T c4d8903d57ea42188e215afce2bde654 P 2435350735ba49d3a8cbc2a2eec7b987: Deleting consensus metadata
I20260811 07:32:25.113236 26278 ts_tablet_manager.cc:1918] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:25.113348 26278 log.cc:1196] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/c4d8903d57ea42188e215afce2bde654
I20260811 07:32:25.113590 25530 tablet_service.cc:1467] Processing CreateTablet for tablet 21d2fb676f704753ad7e517bd4fb406b (DEFAULT_TABLE table=test-table [id=6c66970bff4f4b299c5a42d5d1633512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:25.113722 26278 ts_tablet_manager.cc:1939] T c4d8903d57ea42188e215afce2bde654 P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting consensus metadata
I20260811 07:32:25.113809 25967 tablet_service.cc:1467] Processing CreateTablet for tablet 21d2fb676f704753ad7e517bd4fb406b (DEFAULT_TABLE table=test-table [id=6c66970bff4f4b299c5a42d5d1633512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:25.113909 25530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21d2fb676f704753ad7e517bd4fb406b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:25.114199 25967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21d2fb676f704753ad7e517bd4fb406b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:25.114255 25281 catalog_manager.cc:4841] TS 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029): tablet c4d8903d57ea42188e215afce2bde654 (table test-table [id=41dcfa189e254358bf4219258387671e]) successfully deleted
I20260811 07:32:25.114991 26282 ts_tablet_manager.cc:1918] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:32:25.115063 26282 log.cc:1196] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/c4d8903d57ea42188e215afce2bde654
I20260811 07:32:25.115088 25283 catalog_manager.cc:4841] TS ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461): tablet c4d8903d57ea42188e215afce2bde654 (table test-table [id=41dcfa189e254358bf4219258387671e]) successfully deleted
I20260811 07:32:25.115417 26282 ts_tablet_manager.cc:1939] T c4d8903d57ea42188e215afce2bde654 P cc3d2903e89b4f93a10eec69fa568dad: Deleting consensus metadata
I20260811 07:32:25.115756 25751 tablet_service.cc:1467] Processing CreateTablet for tablet 21d2fb676f704753ad7e517bd4fb406b (DEFAULT_TABLE table=test-table [id=6c66970bff4f4b299c5a42d5d1633512]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:25.116072 25751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 21d2fb676f704753ad7e517bd4fb406b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:25.116644 26256 tablet_bootstrap.cc:492] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: Bootstrap starting.
I20260811 07:32:25.116856 25281 catalog_manager.cc:4841] TS cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139): tablet c4d8903d57ea42188e215afce2bde654 (table test-table [id=41dcfa189e254358bf4219258387671e]) successfully deleted
I20260811 07:32:25.116952 26255 tablet_bootstrap.cc:492] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987: Bootstrap starting.
I20260811 07:32:25.117619 26256 tablet_bootstrap.cc:654] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:25.118009 26255 tablet_bootstrap.cc:654] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:25.118806 26256 tablet_bootstrap.cc:492] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: No bootstrap required, opened a new log
I20260811 07:32:25.118947 26256 ts_tablet_manager.cc:1397] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.001s
I20260811 07:32:25.119452 26256 raft_consensus.cc:348] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.119604 26256 raft_consensus.cc:374] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:25.119632 26256 raft_consensus.cc:729] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc3d2903e89b4f93a10eec69fa568dad, State: Initialized, Role: FOLLOWER
I20260811 07:32:25.119777 26256 consensus_queue.cc:260] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.119940 26255 tablet_bootstrap.cc:492] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987: No bootstrap required, opened a new log
I20260811 07:32:25.120055 26255 ts_tablet_manager.cc:1397] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:25.120069 26256 ts_tablet_manager.cc:1428] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:32:25.120592 26255 raft_consensus.cc:348] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.120770 26255 raft_consensus.cc:374] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:25.120817 26255 raft_consensus.cc:729] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2435350735ba49d3a8cbc2a2eec7b987, State: Initialized, Role: FOLLOWER
I20260811 07:32:25.120970 26255 consensus_queue.cc:260] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.121321 26255 ts_tablet_manager.cc:1428] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 07:32:25.121630 26252 tablet_bootstrap.cc:492] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: Bootstrap starting.
I20260811 07:32:25.122794 26252 tablet_bootstrap.cc:654] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:25.125377 26252 tablet_bootstrap.cc:492] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: No bootstrap required, opened a new log
I20260811 07:32:25.125512 26252 ts_tablet_manager.cc:1397] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 07:32:25.126094 26252 raft_consensus.cc:348] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.126273 26252 raft_consensus.cc:374] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:25.126315 26252 raft_consensus.cc:729] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba2a5ba9fd614b6ca3e91628f81b44a3, State: Initialized, Role: FOLLOWER
I20260811 07:32:25.126498 26252 consensus_queue.cc:260] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.127353 26252 ts_tablet_manager.cc:1428] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:32:25.209731 26212 raft_consensus.cc:482] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:25.209952 26212 raft_consensus.cc:504] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.210556 26212 leader_election.cc:288] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461), cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139)
I20260811 07:32:25.211241 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21d2fb676f704753ad7e517bd4fb406b" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" is_pre_election: true
I20260811 07:32:25.211336 26000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21d2fb676f704753ad7e517bd4fb406b" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc3d2903e89b4f93a10eec69fa568dad" is_pre_election: true
I20260811 07:32:25.211516 25782 raft_consensus.cc:2454] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 0.
I20260811 07:32:25.211699 26000 raft_consensus.cc:2454] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 0.
I20260811 07:32:25.211977 25461 leader_election.cc:302] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, ba2a5ba9fd614b6ca3e91628f81b44a3; no voters:
I20260811 07:32:25.212193 26212 raft_consensus.cc:2781] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:25.212262 26212 raft_consensus.cc:482] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:25.212334 26212 raft_consensus.cc:3037] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:25.213565 26212 raft_consensus.cc:504] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.214031 26212 leader_election.cc:288] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 election: Requested vote from peers ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461), cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139)
I20260811 07:32:25.214637 25782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21d2fb676f704753ad7e517bd4fb406b" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3"
I20260811 07:32:25.214773 26000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "21d2fb676f704753ad7e517bd4fb406b" candidate_uuid: "2435350735ba49d3a8cbc2a2eec7b987" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc3d2903e89b4f93a10eec69fa568dad"
I20260811 07:32:25.214908 25782 raft_consensus.cc:3037] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:25.214960 26000 raft_consensus.cc:3037] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:25.216552 26000 raft_consensus.cc:2454] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 1.
I20260811 07:32:25.216534 25782 raft_consensus.cc:2454] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2435350735ba49d3a8cbc2a2eec7b987 in term 1.
I20260811 07:32:25.217003 25458 leader_election.cc:302] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2435350735ba49d3a8cbc2a2eec7b987, cc3d2903e89b4f93a10eec69fa568dad; no voters:
I20260811 07:32:25.217288 26212 raft_consensus.cc:2781] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:25.217438 26212 raft_consensus.cc:686] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [term 1 LEADER]: Becoming Leader. State: Replica: 2435350735ba49d3a8cbc2a2eec7b987, State: Running, Role: LEADER
I20260811 07:32:25.217657 26212 consensus_queue.cc:237] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } }
I20260811 07:32:25.220340 25299 catalog_manager.cc:5495] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "2435350735ba49d3a8cbc2a2eec7b987" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2435350735ba49d3a8cbc2a2eec7b987" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:25.247807 26293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:25.243293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35442 (local address 127.22.4.193:36029)
0811 07:32:25.243710 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:25.243717 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:25.243732 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:32:25.243779 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:25.243782 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:25.243827 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:25.243912 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:25.244416 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:25.244967 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:25.246290 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:25.246571 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:25.246667 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:25.247131 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:25.247224 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:25.247294 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:25.247428 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 07:32:25.247496 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":142,"threads_started":1}
I20260811 07:32:25.257061 26000 raft_consensus.cc:1261] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Refusing update from remote peer 2435350735ba49d3a8cbc2a2eec7b987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:25.257059 25782 raft_consensus.cc:1261] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Refusing update from remote peer 2435350735ba49d3a8cbc2a2eec7b987: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:25.257519 26212 consensus_queue.cc:1035] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba2a5ba9fd614b6ca3e91628f81b44a3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:25.257715 26219 consensus_queue.cc:1035] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc3d2903e89b4f93a10eec69fa568dad" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:32:25.275250 26209 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 07:32:26.858603 25303 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:26.858896 25303 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:26.863468 25303 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 34260eb0154a4297a9db63b63d0e81f3: Sending DeleteTablet for 3 replicas of tablet 21d2fb676f704753ad7e517bd4fb406b
I20260811 07:32:26.864521 25530 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d2fb676f704753ad7e517bd4fb406b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:26 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:35416
I20260811 07:32:26.864638 25751 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d2fb676f704753ad7e517bd4fb406b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:26 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:38756
I20260811 07:32:26.864660 25967 tablet_service.cc:1514] Processing DeleteTablet for tablet 21d2fb676f704753ad7e517bd4fb406b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:26 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:53658
I20260811 07:32:26.865115 26333 tablet_replica.cc:330] T 21d2fb676f704753ad7e517bd4fb406b P 2435350735ba49d3a8cbc2a2eec7b987: stopping tablet replica
I20260811 07:32:26.865231 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 25427
I20260811 07:32:26.874527 26334 tablet_replica.cc:330] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: stopping tablet replica
I20260811 07:32:26.874912 26334 raft_consensus.cc:2229] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:26.875190 26332 tablet_replica.cc:330] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: stopping tablet replica
I20260811 07:32:26.875247 26334 raft_consensus.cc:2258] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:26.875458 26332 raft_consensus.cc:2229] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:26.875643 26332 raft_consensus.cc:2258] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:26.877517 26334 ts_tablet_manager.cc:1905] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:26.877614 26332 ts_tablet_manager.cc:1905] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:26.880867 26334 ts_tablet_manager.cc:1918] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:32:26.880995 26334 log.cc:1196] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/21d2fb676f704753ad7e517bd4fb406b
I20260811 07:32:26.881306 26334 ts_tablet_manager.cc:1939] T 21d2fb676f704753ad7e517bd4fb406b P cc3d2903e89b4f93a10eec69fa568dad: Deleting consensus metadata
I20260811 07:32:26.882297 25281 catalog_manager.cc:4841] TS cc3d2903e89b4f93a10eec69fa568dad (127.22.4.195:33139): tablet 21d2fb676f704753ad7e517bd4fb406b (table test-table [id=6c66970bff4f4b299c5a42d5d1633512]) successfully deleted
I20260811 07:32:26.882779 26332 ts_tablet_manager.cc:1918] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 07:32:26.882966 26332 log.cc:1196] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/21d2fb676f704753ad7e517bd4fb406b
I20260811 07:32:26.883394 26332 ts_tablet_manager.cc:1939] T 21d2fb676f704753ad7e517bd4fb406b P ba2a5ba9fd614b6ca3e91628f81b44a3: Deleting consensus metadata
I20260811 07:32:26.884776 25283 catalog_manager.cc:4841] TS ba2a5ba9fd614b6ca3e91628f81b44a3 (127.22.4.194:38461): tablet 21d2fb676f704753ad7e517bd4fb406b (table test-table [id=6c66970bff4f4b299c5a42d5d1633512]) successfully deleted
W20260811 07:32:26.889823 25281 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:36029 (error 108)
I20260811 07:32:26.890290 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 25647
I20260811 07:32:26.893918 26337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:26.891764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36029 (local address 127.0.0.1:35448)
0811 07:32:26.893616 (+ 1852us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:26.893726 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:36029: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1753,"thread_start_us":1648,"threads_started":1}
W20260811 07:32:26.896245 25281 catalog_manager.cc:4584] TS 2435350735ba49d3a8cbc2a2eec7b987 (127.22.4.193:36029): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 21d2fb676f704753ad7e517bd4fb406b: Network error: Client connection negotiation failed: client connection to 127.22.4.193:36029: connect: Connection refused (error 111)
I20260811 07:32:26.911893 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 25867
I20260811 07:32:26.934618 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 25254
2026-08-11T07:32:26Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (7712 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:27 dist-test-slave-7z32 krb5kdc[26344](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:27 dist-test-slave-7z32 krb5kdc[26344](info): set up 2 sockets
Aug 11 07:32:27 dist-test-slave-7z32 krb5kdc[26344](info): commencing operation
krb5kdc: starting...
W20260811 07:32:28.329370 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.356s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:28 dist-test-slave-7z32 krb5kdc[26344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:28.505716 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42051
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:42051
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:28.649945 26365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:28.650380 26365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:28.650468 26365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:28.654999 26365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:28.655153 26365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:28.655192 26365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:28.655231 26365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:28.655269 26365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:28.662489 26365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:42051
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42051
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:28.663952 26365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:28.665206 26365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:32:28.677742 26365 server_base.cc:1034] running on GCE node
W20260811 07:32:28.677743 26376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:28.677743 26375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:28.678112 26378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:28.678998 26365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:28.680404 26365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:28.681633 26365 hybrid_clock.cc:648] HybridClock initialized: now 1786433548681615 us; error 47 us; skew 500 ppm
Aug 11 07:32:28 dist-test-slave-7z32 krb5kdc[26344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433548, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:28.685263 26365 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:28.686448 26365 webserver.cc:460] Webserver started at http://127.22.4.254:42535/ using document root <none> and password file <none>
I20260811 07:32:28.687160 26365 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:28.687240 26365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:28.687436 26365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:28.689785 26365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f"
format_stamp: "Formatted at 2026-08-11 07:32:28 on dist-test-slave-7z32"
server_key: "28188fc9e2cf47a6b40d99de4963cf1a"
server_key_iv: "5cb454784f5a54e4f3422d5e20dfba6f"
server_key_version: "encryptionkey@0"
I20260811 07:32:28.690376 26365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f"
format_stamp: "Formatted at 2026-08-11 07:32:28 on dist-test-slave-7z32"
server_key: "28188fc9e2cf47a6b40d99de4963cf1a"
server_key_iv: "5cb454784f5a54e4f3422d5e20dfba6f"
server_key_version: "encryptionkey@0"
I20260811 07:32:28.695505 26365 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:32:28.699275 26385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:28.701443 26365 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:28.701629 26365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f"
format_stamp: "Formatted at 2026-08-11 07:32:28 on dist-test-slave-7z32"
server_key: "28188fc9e2cf47a6b40d99de4963cf1a"
server_key_iv: "5cb454784f5a54e4f3422d5e20dfba6f"
server_key_version: "encryptionkey@0"
I20260811 07:32:28.701749 26365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:28.720149 26365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:28.725332 26365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:28.725553 26365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:28.735386 26365 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:42051
I20260811 07:32:28.736061 26467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:42051 every 8 connection(s)
I20260811 07:32:28.737257 26365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:28.739015 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 26365
I20260811 07:32:28.739189 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:28.739575 22547 external_mini_cluster.cc:1428] Setting key 0232a5e3c8e56d8c9e27b3f46349e530
I20260811 07:32:28.742375 26468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:32:28 dist-test-slave-7z32 krb5kdc[26344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:28.752421 26468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f: Bootstrap starting.
I20260811 07:32:28.757436 26468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:28.759083 26468 log.cc:824] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:28.761420 26475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:28.741767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53618 (local address 127.22.4.254:42051)
0811 07:32:28.742434 (+ 667us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:28.742466 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:28.742888 (+ 422us) server_negotiation.cc:407] Connection header received
0811 07:32:28.743894 (+ 1006us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:28.743918 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:28.744368 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:28.744801 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:28.745841 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:28.747590 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:28.748757 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:28.749397 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:28.749623 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:28.753674 (+ 4051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:28.753683 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:28.753705 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:28.753754 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:28.756657 (+ 2903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:28.757699 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:28.757708 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:28.757715 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:28.757889 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:28.758422 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:28.758426 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:28.758427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:28.759148 (+ 721us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:28.759446 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:28.759990 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 07:32:28.760415 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":208,"threads_started":1}
I20260811 07:32:28.762784 26468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f: No bootstrap required, opened a new log
I20260811 07:32:28.768550 26468 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42051 } }
I20260811 07:32:28.768997 26468 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:28.769099 26468 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbbc295fc8bd4a9ebaecef5faf9ac48f, State: Initialized, Role: FOLLOWER
I20260811 07:32:28.769785 26468 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42051 } }
I20260811 07:32:28.769979 26468 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:28.770040 26468 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:28.770185 26468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:28.772207 26468 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42051 } }
I20260811 07:32:28.773465 26468 leader_election.cc:302] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbbc295fc8bd4a9ebaecef5faf9ac48f; no voters:
I20260811 07:32:28.774246 26468 leader_election.cc:288] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:28.774727 26478 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:28.775205 26478 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [term 1 LEADER]: Becoming Leader. State: Replica: fbbc295fc8bd4a9ebaecef5faf9ac48f, State: Running, Role: LEADER
I20260811 07:32:28.775731 26478 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42051 } }
I20260811 07:32:28.776494 26468 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:28.778667 26481 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbbc295fc8bd4a9ebaecef5faf9ac48f. Latest consensus state: current_term: 1 leader_uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42051 } } }
I20260811 07:32:28.778745 26480 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbbc295fc8bd4a9ebaecef5faf9ac48f" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42051 } } }
I20260811 07:32:28.778992 26480 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:28.778990 26481 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:28.781339 26493 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:28.786221 26493 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:28.797205 26493 catalog_manager.cc:1347] Generated new cluster ID: cdc31baedc434ca087627dfcb43ea0b8
I20260811 07:32:28.797349 26493 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:28.810436 26493 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:28.811990 26493 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:28.827834 26493 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbbc295fc8bd4a9ebaecef5faf9ac48f: Generated new TSK 0
I20260811 07:32:28.828943 26493 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:28.874759 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42051
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:29.039161 26516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:29.039543 26516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:29.039624 26516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:29.043908 26516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:29.044027 26516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:29.044129 26516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:29.050130 26516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:29.051959 26516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:29.053347 26516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:29.065284 26523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:29.065279 26522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:29.065527 26516 server_base.cc:1034] running on GCE node
W20260811 07:32:29.065832 26525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:29.066521 26516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:29.067414 26516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:29.068665 26516 hybrid_clock.cc:648] HybridClock initialized: now 1786433549068639 us; error 45 us; skew 500 ppm
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[26344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:29.072543 26516 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:29.073758 26516 webserver.cc:460] Webserver started at http://127.22.4.193:45017/ using document root <none> and password file <none>
I20260811 07:32:29.074429 26516 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:29.074512 26516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:29.074717 26516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:29.077490 26516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "ef67e61d2f5e4a4bbedbf6eead8ff8a9"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "15fcb02755f43a9747cebb007fbb93e1"
server_key_iv: "c827eb125e725c835511dcab90d4854a"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.078292 26516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "ef67e61d2f5e4a4bbedbf6eead8ff8a9"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "15fcb02755f43a9747cebb007fbb93e1"
server_key_iv: "c827eb125e725c835511dcab90d4854a"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.083583 26516 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260811 07:32:29.087157 26537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.089037 26516 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:29.089227 26516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "ef67e61d2f5e4a4bbedbf6eead8ff8a9"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "15fcb02755f43a9747cebb007fbb93e1"
server_key_iv: "c827eb125e725c835511dcab90d4854a"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.089386 26516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:29.108716 26516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:29.113095 26516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:29.113337 26516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:29.114077 26516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:29.115161 26516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:29.115242 26516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.115319 26516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:29.115365 26516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.128430 26516 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:44925
I20260811 07:32:29.128530 26703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:44925 every 8 connection(s)
I20260811 07:32:29.129694 26516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:29.137439 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 26516
I20260811 07:32:29.137611 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:29.137951 22547 external_mini_cluster.cc:1428] Setting key 3fd69a0d7fde10bd6de4912a5591b9cb
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[26344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:29.152016 26475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:29.133127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:54469 (local address 127.22.4.254:42051)
0811 07:32:29.133388 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:29.133393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:29.135475 (+ 2082us) server_negotiation.cc:407] Connection header received
0811 07:32:29.136734 (+ 1259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:29.136738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:29.136811 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:29.136907 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:29.138806 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.139640 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.141417 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.141900 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.142082 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:29.145986 (+ 3904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:29.145995 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:29.146001 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:29.146053 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:29.148622 (+ 2569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:29.149568 (+ 946us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:29.149574 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:29.149578 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:29.149727 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:29.150228 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:29.150235 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:29.150240 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:29.150610 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:29.150745 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:29.151558 (+ 813us) server_negotiation.cc:299] Negotiation successful
0811 07:32:29.151774 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 07:32:29.152949 26709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:29.133754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:42051 (local address 127.22.4.193:54469)
0811 07:32:29.135222 (+ 1468us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:29.135309 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:29.136405 (+ 1096us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:29.137176 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:29.137190 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:29.137816 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:29.138619 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:29.138640 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.139905 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.139914 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:29.141222 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:29.141242 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.142191 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.142195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:29.142406 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:29.143314 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:29.143336 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:29.145654 (+ 2318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:29.148917 (+ 3263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:29.148926 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:29.148955 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:29.149388 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:29.149893 (+ 505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:29.149895 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:29.149897 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:29.150088 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:29.150781 (+ 693us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:29.150788 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:29.151204 (+ 416us) client_negotiation.cc:769] Sending connection context
0811 07:32:29.151449 (+ 245us) client_negotiation.cc:240] Negotiation successful
0811 07:32:29.151825 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1119,"thread_start_us":734,"threads_started":1}
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:32:29.154930 26705 heartbeater.cc:347] Connected to a master server at 127.22.4.254:42051
I20260811 07:32:29.155277 26705 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:29.155944 26705 heartbeater.cc:511] Master 127.22.4.254:42051 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:32:29.158493 26413 ts_manager.cc:194] Registered new tserver with Master: ef67e61d2f5e4a4bbedbf6eead8ff8a9 (127.22.4.193:44925)
I20260811 07:32:29.160327 26413 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:54469
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:29.188022 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42051
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:29.345863 26713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:29.346304 26713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:29.346359 26713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:29.351116 26713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:29.351225 26713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:29.351333 26713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:29.358021 26713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:29.359819 26713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:29.361289 26713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:29.374939 26727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:29.374995 26725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:29.374996 26722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:29.375069 26713 server_base.cc:1034] running on GCE node
I20260811 07:32:29.376048 26713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:29.377058 26713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:29.378340 26713 hybrid_clock.cc:648] HybridClock initialized: now 1786433549378281 us; error 77 us; skew 500 ppm
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[26344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:29.383306 26713 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:29.384814 26713 webserver.cc:460] Webserver started at http://127.22.4.194:46781/ using document root <none> and password file <none>
I20260811 07:32:29.385699 26713 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:29.385833 26713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:29.386168 26713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:29.389305 26713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "f36dc5734ada4ea590b712b14c8d57a5"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "183b4682e5829484d475bc4aa4297935"
server_key_iv: "bd91ce65c59252e5a5367aaf9fd3a2f1"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.390136 26713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "f36dc5734ada4ea590b712b14c8d57a5"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "183b4682e5829484d475bc4aa4297935"
server_key_iv: "bd91ce65c59252e5a5367aaf9fd3a2f1"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.396414 26713 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260811 07:32:29.401178 26737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.403543 26713 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:29.403880 26713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "f36dc5734ada4ea590b712b14c8d57a5"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "183b4682e5829484d475bc4aa4297935"
server_key_iv: "bd91ce65c59252e5a5367aaf9fd3a2f1"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.404080 26713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:29.424932 26713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:29.429467 26713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:29.429767 26713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:29.430616 26713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:29.431833 26713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:29.431921 26713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.432004 26713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:29.432060 26713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.446383 26713 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:37889
I20260811 07:32:29.446532 26917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:37889 every 8 connection(s)
I20260811 07:32:29.447912 26713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:29.451109 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 26713
I20260811 07:32:29.451299 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:29.451615 22547 external_mini_cluster.cc:1428] Setting key 32116ca8cfa8beaefe5f96608e03531f
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[26344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:29.469790 26475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:29.450883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:54475 (local address 127.22.4.254:42051)
0811 07:32:29.451138 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:29.451147 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:29.452594 (+ 1447us) server_negotiation.cc:407] Connection header received
0811 07:32:29.454665 (+ 2071us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:29.454669 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:29.454735 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:29.454918 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:29.457023 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.458014 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.459634 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.460067 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.460235 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:29.464567 (+ 4332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:29.464573 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:29.464577 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:29.464627 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:29.466620 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:29.467618 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:29.467621 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:29.467622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:29.467727 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:29.468313 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:29.468316 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:29.468317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:29.468578 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:29.468674 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:29.469411 (+ 737us) server_negotiation.cc:299] Negotiation successful
0811 07:32:29.469600 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:32:29.471074 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:29.451456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:42051 (local address 127.22.4.194:54475)
0811 07:32:29.452316 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:29.452390 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:29.454299 (+ 1909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:29.455175 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:29.455190 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:29.455870 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:29.456786 (+ 916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:29.456806 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.458236 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.458240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:29.459460 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:29.459474 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.460293 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.460296 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:29.460505 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:29.461401 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:29.461434 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:29.464255 (+ 2821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:29.466815 (+ 2560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:29.466903 (+ 88us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:29.466932 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:29.467407 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:29.467884 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:29.467886 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:29.467888 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:29.468145 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:29.468731 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:29.468738 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:29.469084 (+ 346us) client_negotiation.cc:769] Sending connection context
0811 07:32:29.469288 (+ 204us) client_negotiation.cc:240] Negotiation successful
0811 07:32:29.469783 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":249,"threads_started":1}
I20260811 07:32:29.473407 26918 heartbeater.cc:347] Connected to a master server at 127.22.4.254:42051
I20260811 07:32:29.473819 26918 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:29.474609 26918 heartbeater.cc:511] Master 127.22.4.254:42051 requested a full tablet report, sending...
I20260811 07:32:29.476457 26413 ts_manager.cc:194] Registered new tserver with Master: f36dc5734ada4ea590b712b14c8d57a5 (127.22.4.194:37889)
I20260811 07:32:29.477594 26413 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:54475
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:29.496420 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42051
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:29.653852 26923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:29.654247 26923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:29.654299 26923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:29.658777 26923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:29.658922 26923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:29.658993 26923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:29.665179 26923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42051
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:29.666647 26923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:29.667984 26923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:32:29.681264 26923 server_base.cc:1034] running on GCE node
W20260811 07:32:29.681155 26933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:29.681119 26935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:29.681133 26932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:29.682253 26923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:29.683262 26923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:29.684468 26923 hybrid_clock.cc:648] HybridClock initialized: now 1786433549684427 us; error 61 us; skew 500 ppm
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[26344](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:29.688815 26923 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:29.690385 26923 webserver.cc:460] Webserver started at http://127.22.4.195:34523/ using document root <none> and password file <none>
I20260811 07:32:29.691349 26923 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:29.691470 26923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:29.691799 26923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:29.694944 26923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "21706d647a93497383f4b46a62fc78df"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "0e8d9156b10b732964a7e24f836ef6c0"
server_key_iv: "f2db9ec5ac4b7a30a2cf2e0c206292b8"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.695717 26923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "21706d647a93497383f4b46a62fc78df"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "0e8d9156b10b732964a7e24f836ef6c0"
server_key_iv: "f2db9ec5ac4b7a30a2cf2e0c206292b8"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.701354 26923 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 07:32:29.705200 26951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.707340 26923 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:32:29.707578 26923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "21706d647a93497383f4b46a62fc78df"
format_stamp: "Formatted at 2026-08-11 07:32:29 on dist-test-slave-7z32"
server_key: "0e8d9156b10b732964a7e24f836ef6c0"
server_key_iv: "f2db9ec5ac4b7a30a2cf2e0c206292b8"
server_key_version: "encryptionkey@0"
I20260811 07:32:29.707767 26923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:29.729331 26923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:29.734092 26923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:29.734398 26923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:29.735462 26923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:29.736652 26923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:29.736739 26923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.736824 26923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:29.736872 26923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:29.751190 26923 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:33425
I20260811 07:32:29.751204 27133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:33425 every 8 connection(s)
I20260811 07:32:29.752422 26923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:29.758896 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 26923
I20260811 07:32:29.759070 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:29.759470 22547 external_mini_cluster.cc:1428] Setting key 24a7bb7c9b2159034e8dc865a944dcea
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[26344](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433549, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:29.773056 26475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:29.755262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:48035 (local address 127.22.4.254:42051)
0811 07:32:29.755450 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:29.755455 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:29.756674 (+ 1219us) server_negotiation.cc:407] Connection header received
0811 07:32:29.758410 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:29.758413 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:29.758493 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:29.758614 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:29.760837 (+ 2223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.761644 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.763558 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.763839 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.764000 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:29.767903 (+ 3903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:29.767908 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:29.767910 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:29.767951 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:29.769862 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:29.770800 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:29.770805 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:29.770807 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:29.770989 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:29.771528 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:29.771531 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:29.771532 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:29.771779 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:29.771881 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:29.772756 (+ 875us) server_negotiation.cc:299] Negotiation successful
0811 07:32:29.772915 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:32:29.774513 27136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:29.755719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:42051 (local address 127.22.4.195:48035)
0811 07:32:29.756413 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:29.756476 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:29.758008 (+ 1532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:29.758988 (+ 980us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:29.759002 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:29.759721 (+ 719us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:29.760611 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:29.760632 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.761834 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.761839 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:29.763359 (+ 1520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:29.763375 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:29.764111 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:29.764115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:29.764336 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:29.765256 (+ 920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:29.765281 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:29.767586 (+ 2305us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:29.770071 (+ 2485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:29.770080 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:29.770106 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:29.770560 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:29.771140 (+ 580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:29.771143 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:29.771145 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:29.771370 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:29.771939 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:29.771948 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:29.772377 (+ 429us) client_negotiation.cc:769] Sending connection context
0811 07:32:29.772631 (+ 254us) client_negotiation.cc:240] Negotiation successful
0811 07:32:29.773075 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":160,"threads_started":1}
I20260811 07:32:29.776237 27134 heartbeater.cc:347] Connected to a master server at 127.22.4.254:42051
I20260811 07:32:29.776728 27134 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:29.777534 27134 heartbeater.cc:511] Master 127.22.4.254:42051 requested a full tablet report, sending...
I20260811 07:32:29.779328 26413 ts_manager.cc:194] Registered new tserver with Master: 21706d647a93497383f4b46a62fc78df (127.22.4.195:33425)
I20260811 07:32:29.780155 26413 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:48035
I20260811 07:32:29.789059 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:32:29.811852 26475 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:29.809459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53620 (local address 127.22.4.254:42051)
0811 07:32:29.809702 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:29.809709 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:29.810048 (+ 339us) server_negotiation.cc:407] Connection header received
0811 07:32:29.810188 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:29.810193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:29.810266 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:29.810376 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:29.811541 (+ 1165us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53620: BlockingRecv error: recv got EOF from 127.0.0.1:53620 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:32:29.813046 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 26516
I20260811 07:32:29.831881 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 26713
I20260811 07:32:29.844331 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 26923
I20260811 07:32:29.868520 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 26365
2026-08-11T07:32:29Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2934 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[27153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[27153](info): set up 2 sockets
Aug 11 07:32:29 dist-test-slave-7z32 krb5kdc[27153](info): commencing operation
krb5kdc: starting...
W20260811 07:32:31.220155 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.313s user 0.001s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:31 dist-test-slave-7z32 krb5kdc[27153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:31.412870 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42839
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:43331
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:42839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:31.565279 27172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:31.565637 27172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:31.565683 27172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:31.569963 27172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:31.570053 27172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:31.570075 27172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:31.570093 27172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:31.570109 27172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:31.576052 27172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:43331
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:42839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27172
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:31.577508 27172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:31.578857 27172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:31.590245 27183 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:31.590227 27179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:31.590227 27181 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:31.590898 27172 server_base.cc:1034] running on GCE node
I20260811 07:32:31.591785 27172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:31.593504 27172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:31.594789 27172 hybrid_clock.cc:648] HybridClock initialized: now 1786433551594735 us; error 77 us; skew 500 ppm
Aug 11 07:32:31 dist-test-slave-7z32 krb5kdc[27153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433551, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:31.606333 27172 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:31.608036 27172 webserver.cc:460] Webserver started at http://127.22.4.254:36165/ using document root <none> and password file <none>
I20260811 07:32:31.608852 27172 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:31.608930 27172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:31.609165 27172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:31.612113 27172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "15f3829f3471495689399b39ca9d91a2"
format_stamp: "Formatted at 2026-08-11 07:32:31 on dist-test-slave-7z32"
server_key: "b766ae0e49ccfcc8d3348777fe0c0443"
server_key_iv: "8dd5d50a34db714c218360436e5e425d"
server_key_version: "encryptionkey@0"
I20260811 07:32:31.612823 27172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "15f3829f3471495689399b39ca9d91a2"
format_stamp: "Formatted at 2026-08-11 07:32:31 on dist-test-slave-7z32"
server_key: "b766ae0e49ccfcc8d3348777fe0c0443"
server_key_iv: "8dd5d50a34db714c218360436e5e425d"
server_key_version: "encryptionkey@0"
I20260811 07:32:31.618620 27172 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 07:32:31.622769 27198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:31.624939 27172 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:31.625140 27172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "15f3829f3471495689399b39ca9d91a2"
format_stamp: "Formatted at 2026-08-11 07:32:31 on dist-test-slave-7z32"
server_key: "b766ae0e49ccfcc8d3348777fe0c0443"
server_key_iv: "8dd5d50a34db714c218360436e5e425d"
server_key_version: "encryptionkey@0"
I20260811 07:32:31.625330 27172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:31.681052 27172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:31.685613 27172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:31.685956 27172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:31.695999 27172 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:42839
I20260811 07:32:31.696506 27284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:42839 every 8 connection(s)
I20260811 07:32:31.697592 27172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:31.702073 27289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:31.706046 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 27172
I20260811 07:32:31.706228 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:31.706595 22547 external_mini_cluster.cc:1428] Setting key 9d4c842463e6d6e2f91ead5dd4262e69
I20260811 07:32:31.712308 27289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2: Bootstrap starting.
I20260811 07:32:31.716264 27289 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:31.717556 27289 log.cc:824] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:32:31 dist-test-slave-7z32 krb5kdc[27153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:31.720777 27289 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2: No bootstrap required, opened a new log
I20260811 07:32:31.725553 27298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:31.708937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43984 (local address 127.22.4.254:42839)
0811 07:32:31.709788 (+ 851us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:31.709812 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:31.709869 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:32:31.710812 (+ 943us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:31.710926 (+ 114us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:31.711407 (+ 481us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:31.711839 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:31.712921 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:31.713993 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:31.714973 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:31.715514 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:31.715700 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:31.719470 (+ 3770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:31.719477 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:31.719501 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:31.719541 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:31.721698 (+ 2157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:31.722306 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:31.722312 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:31.722319 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:31.722465 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:31.722806 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:31.722816 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:31.722818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:31.723455 (+ 637us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:31.723762 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:31.724032 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 07:32:31.724464 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":236,"threads_started":1}
I20260811 07:32:31.726022 27289 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3829f3471495689399b39ca9d91a2" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42839 } }
I20260811 07:32:31.726367 27289 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:31.726467 27289 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f3829f3471495689399b39ca9d91a2, State: Initialized, Role: FOLLOWER
I20260811 07:32:31.727118 27289 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3829f3471495689399b39ca9d91a2" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42839 } }
I20260811 07:32:31.727305 27289 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:31.727377 27289 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:31.727494 27289 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:31.728876 27289 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3829f3471495689399b39ca9d91a2" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42839 } }
I20260811 07:32:31.729317 27289 leader_election.cc:302] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15f3829f3471495689399b39ca9d91a2; no voters:
I20260811 07:32:31.729825 27289 leader_election.cc:288] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:31.730077 27302 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:31.730197 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:32:31.730450 27302 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [term 1 LEADER]: Becoming Leader. State: Replica: 15f3829f3471495689399b39ca9d91a2, State: Running, Role: LEADER
I20260811 07:32:31.731027 27302 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3829f3471495689399b39ca9d91a2" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42839 } }
I20260811 07:32:31.731426 27289 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:31.733459 27304 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15f3829f3471495689399b39ca9d91a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3829f3471495689399b39ca9d91a2" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42839 } } }
I20260811 07:32:31.733639 27304 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:31.733992 27306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f3829f3471495689399b39ca9d91a2. Latest consensus state: current_term: 1 leader_uuid: "15f3829f3471495689399b39ca9d91a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f3829f3471495689399b39ca9d91a2" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42839 } } }
I20260811 07:32:31.734097 27324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:31.734634 27306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:31.738336 27324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:31.747454 27324 catalog_manager.cc:1347] Generated new cluster ID: 47be043539d9415f96aa01f0d38bae46
I20260811 07:32:31.747557 27324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:31.760826 27298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:31.753558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43996 (local address 127.22.4.254:42839)
0811 07:32:31.753731 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:31.753736 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:31.754151 (+ 415us) server_negotiation.cc:407] Connection header received
0811 07:32:31.754340 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:31.754344 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:31.754420 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:31.754535 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:31.755462 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:31.756307 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:31.757736 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:31.758129 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:31.758237 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:31.759499 (+ 1262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:31.759503 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:31.759506 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:31.760235 (+ 729us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:31.760279 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:31.760301 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:31.760405 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:31.760556 (+ 151us) server_negotiation.cc:299] Negotiation successful
0811 07:32:31.760649 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:32:31.767870 27324 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:31.769619 27324 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:31.779572 27324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15f3829f3471495689399b39ca9d91a2: Generated new TSK 0
I20260811 07:32:31.780709 27324 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:32:31.788762 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 27172
2026-08-11T07:32:31Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1921 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:31 dist-test-slave-7z32 krb5kdc[27340](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:31 dist-test-slave-7z32 krb5kdc[27340](info): set up 2 sockets
Aug 11 07:32:31 dist-test-slave-7z32 krb5kdc[27340](info): commencing operation
krb5kdc: starting...
W20260811 07:32:33.169652 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.341s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:33 dist-test-slave-7z32 krb5kdc[27340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:33.343536 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:43647
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:43647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:33.505688 27359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:33.506162 27359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:33.506218 27359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:33.511482 27359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:33.511605 27359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:33.511632 27359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:33.511652 27359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:33.511670 27359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:33.518667 27359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:43647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:43647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:33.520380 27359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:33.521849 27359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:33.534293 27368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:33.534300 27369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:33.534300 27371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:33.534698 27359 server_base.cc:1034] running on GCE node
I20260811 07:32:33.535681 27359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:33.537405 27359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:33.540921 27359 hybrid_clock.cc:648] HybridClock initialized: now 1786433553540843 us; error 87 us; skew 500 ppm
Aug 11 07:32:33 dist-test-slave-7z32 krb5kdc[27340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433553, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:33.545585 27359 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:33.547346 27359 webserver.cc:460] Webserver started at http://127.22.4.254:43061/ using document root <none> and password file <none>
I20260811 07:32:33.548195 27359 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:33.548314 27359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:33.548623 27359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:33.551962 27359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "eec686f1444e45e7ae5a9e1af46b9a33"
format_stamp: "Formatted at 2026-08-11 07:32:33 on dist-test-slave-7z32"
server_key: "5097e63e57b60bb49e5a8464e79f0669"
server_key_iv: "3c80576a8ad446654020ce40fb797069"
server_key_version: "encryptionkey@0"
I20260811 07:32:33.552827 27359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "eec686f1444e45e7ae5a9e1af46b9a33"
format_stamp: "Formatted at 2026-08-11 07:32:33 on dist-test-slave-7z32"
server_key: "5097e63e57b60bb49e5a8464e79f0669"
server_key_iv: "3c80576a8ad446654020ce40fb797069"
server_key_version: "encryptionkey@0"
I20260811 07:32:33.558781 27359 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s
I20260811 07:32:33.563354 27384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:33.565641 27359 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.003s
I20260811 07:32:33.566071 27359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "eec686f1444e45e7ae5a9e1af46b9a33"
format_stamp: "Formatted at 2026-08-11 07:32:33 on dist-test-slave-7z32"
server_key: "5097e63e57b60bb49e5a8464e79f0669"
server_key_iv: "3c80576a8ad446654020ce40fb797069"
server_key_version: "encryptionkey@0"
I20260811 07:32:33.566309 27359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:33.609092 27359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:33.613826 27359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:33.614142 27359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:33.624822 27359 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:43647
I20260811 07:32:33.625351 27454 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:43647 every 8 connection(s)
I20260811 07:32:33.626308 27359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:33.630213 27457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:33.636518 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 27359
I20260811 07:32:33.636693 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:33.636713 27457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33: Bootstrap starting.
I20260811 07:32:33.637023 22547 external_mini_cluster.cc:1428] Setting key 7abdcc147d9c219eb470ae4ecdb52c43
I20260811 07:32:33.640056 27457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:33.640995 27457 log.cc:824] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:33.644150 27457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33: No bootstrap required, opened a new log
Aug 11 07:32:33 dist-test-slave-7z32 krb5kdc[27340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:33.649843 27457 raft_consensus.cc:348] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec686f1444e45e7ae5a9e1af46b9a33" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 43647 } }
I20260811 07:32:33.650185 27457 raft_consensus.cc:374] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:33.650255 27457 raft_consensus.cc:729] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eec686f1444e45e7ae5a9e1af46b9a33, State: Initialized, Role: FOLLOWER
I20260811 07:32:33.650863 27457 consensus_queue.cc:260] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec686f1444e45e7ae5a9e1af46b9a33" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 43647 } }
I20260811 07:32:33.651054 27457 raft_consensus.cc:388] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:33.651173 27457 raft_consensus.cc:482] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:33.651298 27457 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:33.652416 27457 raft_consensus.cc:504] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec686f1444e45e7ae5a9e1af46b9a33" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 43647 } }
I20260811 07:32:33.652850 27457 leader_election.cc:302] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eec686f1444e45e7ae5a9e1af46b9a33; no voters:
I20260811 07:32:33.653295 27457 leader_election.cc:288] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:33.653445 27464 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:33.653684 27464 raft_consensus.cc:686] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [term 1 LEADER]: Becoming Leader. State: Replica: eec686f1444e45e7ae5a9e1af46b9a33, State: Running, Role: LEADER
I20260811 07:32:33.654062 27464 consensus_queue.cc:237] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec686f1444e45e7ae5a9e1af46b9a33" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 43647 } }
I20260811 07:32:33.654992 27457 sys_catalog.cc:564] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:33.655613 27464 sys_catalog.cc:455] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eec686f1444e45e7ae5a9e1af46b9a33. Latest consensus state: current_term: 1 leader_uuid: "eec686f1444e45e7ae5a9e1af46b9a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec686f1444e45e7ae5a9e1af46b9a33" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 43647 } } }
I20260811 07:32:33.655757 27464 sys_catalog.cc:458] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:33.656584 27467 sys_catalog.cc:455] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eec686f1444e45e7ae5a9e1af46b9a33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eec686f1444e45e7ae5a9e1af46b9a33" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 43647 } } }
I20260811 07:32:33.656704 27467 sys_catalog.cc:458] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:33.656817 27470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:33.657740 27461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:33.639084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44770 (local address 127.22.4.254:43647)
0811 07:32:33.639729 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:33.639749 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:33.639799 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:32:33.640773 (+ 974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:33.640799 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:33.641345 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:33.641888 (+ 543us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:33.643213 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:33.644661 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:33.646027 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:33.646637 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:33.646894 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:33.650640 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:33.650648 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:33.650681 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:33.650737 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:33.653227 (+ 2490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:33.654003 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:33.654011 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:33.654019 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:33.654230 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:33.654568 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:33.654572 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:33.654574 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:33.655290 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:33.655560 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:33.655878 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 07:32:33.656313 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":196,"threads_started":1}
I20260811 07:32:33.661556 27470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:33.669979 27470 catalog_manager.cc:1347] Generated new cluster ID: d2287f6b2ba149eead471af04ac320cf
I20260811 07:32:33.670123 27470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:33.676752 27470 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:33.678402 27470 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:33.692274 27470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eec686f1444e45e7ae5a9e1af46b9a33: Generated new TSK 0
I20260811 07:32:33.693387 27470 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:33.740636 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:43647
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:33.898518 27502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:33.899066 27502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:33.899159 27502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:33.903921 27502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:33.904085 27502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:33.904201 27502 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:33.910703 27502 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:43647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:33.912428 27502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:33.913942 27502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:33.928597 27512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:33.928681 27509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:33.928855 27502 server_base.cc:1034] running on GCE node
W20260811 07:32:33.928747 27515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:33.929661 27502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:33.930735 27502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:33.932020 27502 hybrid_clock.cc:648] HybridClock initialized: now 1786433553932004 us; error 44 us; skew 500 ppm
Aug 11 07:32:33 dist-test-slave-7z32 krb5kdc[27340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433553, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:33.935722 27502 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:33.937037 27502 webserver.cc:460] Webserver started at http://127.22.4.193:42905/ using document root <none> and password file <none>
I20260811 07:32:33.937855 27502 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:33.937970 27502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:33.938308 27502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:33.941550 27502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "81de265d249a4d7ba9476b59af55ce7f"
format_stamp: "Formatted at 2026-08-11 07:32:33 on dist-test-slave-7z32"
server_key: "5ece33edc415d76b47452d053ceee68b"
server_key_iv: "8db75fe8b9eea57f8a01de88e6003b10"
server_key_version: "encryptionkey@0"
I20260811 07:32:33.942476 27502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "81de265d249a4d7ba9476b59af55ce7f"
format_stamp: "Formatted at 2026-08-11 07:32:33 on dist-test-slave-7z32"
server_key: "5ece33edc415d76b47452d053ceee68b"
server_key_iv: "8db75fe8b9eea57f8a01de88e6003b10"
server_key_version: "encryptionkey@0"
I20260811 07:32:33.949810 27502 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260811 07:32:33.954499 27529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:33.957516 27502 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:32:33.957873 27502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "81de265d249a4d7ba9476b59af55ce7f"
format_stamp: "Formatted at 2026-08-11 07:32:33 on dist-test-slave-7z32"
server_key: "5ece33edc415d76b47452d053ceee68b"
server_key_iv: "8db75fe8b9eea57f8a01de88e6003b10"
server_key_version: "encryptionkey@0"
I20260811 07:32:33.958176 27502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:33.982349 27502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:33.987061 27502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:33.987337 27502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:33.988219 27502 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:33.989432 27502 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:33.989521 27502 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:33.989604 27502 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:33.989650 27502 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:34.004410 27502 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:32829
I20260811 07:32:34.004431 27699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:32829 every 8 connection(s)
I20260811 07:32:34.005751 27502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:34.014232 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 27502
I20260811 07:32:34.014429 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:34.014869 22547 external_mini_cluster.cc:1428] Setting key 74e419c7ee3ffd416d6f072f16c4cca1
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[27340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433553, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:32:34.028434 27461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:34.008823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:50429 (local address 127.22.4.254:43647)
0811 07:32:34.009052 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:34.009058 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:34.010308 (+ 1250us) server_negotiation.cc:407] Connection header received
0811 07:32:34.012708 (+ 2400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:34.012714 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:34.012808 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:34.012906 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:34.015366 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.016004 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.017594 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.018239 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.018435 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:34.023497 (+ 5062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:34.023503 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:34.023505 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:34.023545 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:34.025546 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:34.026359 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:34.026363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:34.026364 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:34.026460 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:34.026914 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:34.026917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:34.026919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:34.027178 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:34.027297 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:34.028025 (+ 728us) server_negotiation.cc:299] Negotiation successful
0811 07:32:34.028209 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:32:34.029691 27706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:34.009144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:43647 (local address 127.22.4.193:50429)
0811 07:32:34.009997 (+ 853us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:34.010079 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:34.012095 (+ 2016us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:34.013341 (+ 1246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:34.013354 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:34.013955 (+ 601us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:34.015098 (+ 1143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:34.015128 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.016211 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.016214 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:34.017396 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:34.017419 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.018550 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.018556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:34.018954 (+ 398us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:34.020141 (+ 1187us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:34.020169 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:34.023135 (+ 2966us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:34.025753 (+ 2618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:34.025763 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:34.025801 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:34.026208 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:34.026570 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:34.026574 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:34.026576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:34.026770 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:34.027298 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:34.027309 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:34.027682 (+ 373us) client_negotiation.cc:769] Sending connection context
0811 07:32:34.027965 (+ 283us) client_negotiation.cc:240] Negotiation successful
0811 07:32:34.028465 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":200,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:32:34.031842 27701 heartbeater.cc:347] Connected to a master server at 127.22.4.254:43647
I20260811 07:32:34.032269 27701 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:34.033041 27701 heartbeater.cc:511] Master 127.22.4.254:43647 requested a full tablet report, sending...
I20260811 07:32:34.035384 27411 ts_manager.cc:194] Registered new tserver with Master: 81de265d249a4d7ba9476b59af55ce7f (127.22.4.193:32829)
I20260811 07:32:34.036885 27411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:50429
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:34.056563 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:43647
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:34.194578 27710 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:34.194986 27710 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:34.195046 27710 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:34.199800 27710 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:34.199894 27710 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:34.199959 27710 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:34.206197 27710 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:43647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:34.207633 27710 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:34.208880 27710 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:34.220918 27719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:34.220884 27721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:34.220956 27718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:34.221473 27710 server_base.cc:1034] running on GCE node
I20260811 07:32:34.222031 27710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:34.223063 27710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:34.224340 27710 hybrid_clock.cc:648] HybridClock initialized: now 1786433554224290 us; error 112 us; skew 500 ppm
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[27340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433554, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:34.228227 27710 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:34.229442 27710 webserver.cc:460] Webserver started at http://127.22.4.194:32773/ using document root <none> and password file <none>
I20260811 07:32:34.230129 27710 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:34.230203 27710 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:34.230409 27710 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:34.233016 27710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "844de99dc2d5422c99571e45ea173307"
format_stamp: "Formatted at 2026-08-11 07:32:34 on dist-test-slave-7z32"
server_key: "592c4e3cb3de36ea453316e1abfb8afb"
server_key_iv: "f477bcc8d89d1ba992c4384b08dcaf9f"
server_key_version: "encryptionkey@0"
I20260811 07:32:34.233626 27710 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "844de99dc2d5422c99571e45ea173307"
format_stamp: "Formatted at 2026-08-11 07:32:34 on dist-test-slave-7z32"
server_key: "592c4e3cb3de36ea453316e1abfb8afb"
server_key_iv: "f477bcc8d89d1ba992c4384b08dcaf9f"
server_key_version: "encryptionkey@0"
I20260811 07:32:34.238694 27710 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s
I20260811 07:32:34.242182 27729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:34.244073 27710 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:34.244271 27710 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "844de99dc2d5422c99571e45ea173307"
format_stamp: "Formatted at 2026-08-11 07:32:34 on dist-test-slave-7z32"
server_key: "592c4e3cb3de36ea453316e1abfb8afb"
server_key_iv: "f477bcc8d89d1ba992c4384b08dcaf9f"
server_key_version: "encryptionkey@0"
I20260811 07:32:34.244423 27710 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:34.261358 27710 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:34.266023 27710 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:34.266292 27710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:34.267177 27710 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:34.268260 27710 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:34.268342 27710 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:34.268425 27710 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:34.268472 27710 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:34.282039 27710 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:44345
I20260811 07:32:34.282090 27898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:44345 every 8 connection(s)
I20260811 07:32:34.283332 27710 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:34.287405 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 27710
I20260811 07:32:34.287586 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:34.288012 22547 external_mini_cluster.cc:1428] Setting key 7306641699f41cc06f193ccb81d1a0d1
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[27340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433554, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:34.304831 27461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:34.286369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:39817 (local address 127.22.4.254:43647)
0811 07:32:34.286569 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:34.286573 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:34.287746 (+ 1173us) server_negotiation.cc:407] Connection header received
0811 07:32:34.290093 (+ 2347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:34.290098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:34.290167 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:34.290289 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:34.293616 (+ 3327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.294307 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.296017 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.296272 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.296405 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:34.300186 (+ 3781us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:34.300190 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:34.300192 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:34.300223 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:34.302081 (+ 1858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:34.302751 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:34.302754 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:34.302756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:34.302910 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:34.303301 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:34.303305 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:34.303306 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:34.303656 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:34.303773 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:34.304468 (+ 695us) server_negotiation.cc:299] Negotiation successful
0811 07:32:34.304635 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:32:34.305809 27909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:34.286610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:43647 (local address 127.22.4.194:39817)
0811 07:32:34.287433 (+ 823us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:34.287529 (+ 96us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:34.289705 (+ 2176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:34.290632 (+ 927us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:34.290647 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:34.291636 (+ 989us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:34.293267 (+ 1631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:34.293312 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.294627 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.294633 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:34.295816 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:34.295837 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.296478 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.296484 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:34.296693 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:34.297626 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:34.297645 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:34.299894 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:34.302248 (+ 2354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:34.302256 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:34.302278 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:34.302616 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:34.303018 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:34.303021 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:34.303023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:34.303187 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:34.303788 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:34.303797 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:34.304110 (+ 313us) client_negotiation.cc:769] Sending connection context
0811 07:32:34.304405 (+ 295us) client_negotiation.cc:240] Negotiation successful
0811 07:32:34.304795 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":229,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:32:34.307842 27900 heartbeater.cc:347] Connected to a master server at 127.22.4.254:43647
I20260811 07:32:34.308256 27900 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:34.309036 27900 heartbeater.cc:511] Master 127.22.4.254:43647 requested a full tablet report, sending...
I20260811 07:32:34.310669 27411 ts_manager.cc:194] Registered new tserver with Master: 844de99dc2d5422c99571e45ea173307 (127.22.4.194:44345)
I20260811 07:32:34.311560 27411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:39817
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:34.332222 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:43647
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:33997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:34.481405 27914 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:34.481767 27914 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:34.481819 27914 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:34.486141 27914 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:34.486233 27914 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:34.486302 27914 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:34.492408 27914 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:33997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:43647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27914
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:34.493940 27914 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:34.495621 27914 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:34.510850 27926 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:34.510995 27914 server_base.cc:1034] running on GCE node
W20260811 07:32:34.510829 27922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:34.510849 27924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:34.511870 27914 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:34.512807 27914 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:34.514081 27914 hybrid_clock.cc:648] HybridClock initialized: now 1786433554514023 us; error 71 us; skew 500 ppm
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[27340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433554, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:34.518357 27914 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:34.520006 27914 webserver.cc:460] Webserver started at http://127.22.4.195:44567/ using document root <none> and password file <none>
I20260811 07:32:34.520829 27914 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:34.520938 27914 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:34.521270 27914 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:34.524660 27914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "b9f977e3509147e2afb3d25715fefe94"
format_stamp: "Formatted at 2026-08-11 07:32:34 on dist-test-slave-7z32"
server_key: "5dfd3e75df5fa43ff51a39534e7df92c"
server_key_iv: "68e75ffb98f513748c165ad8597020b4"
server_key_version: "encryptionkey@0"
I20260811 07:32:34.525496 27914 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "b9f977e3509147e2afb3d25715fefe94"
format_stamp: "Formatted at 2026-08-11 07:32:34 on dist-test-slave-7z32"
server_key: "5dfd3e75df5fa43ff51a39534e7df92c"
server_key_iv: "68e75ffb98f513748c165ad8597020b4"
server_key_version: "encryptionkey@0"
I20260811 07:32:34.531852 27914 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:32:34.536214 27935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:34.538218 27914 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:34.538492 27914 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "b9f977e3509147e2afb3d25715fefe94"
format_stamp: "Formatted at 2026-08-11 07:32:34 on dist-test-slave-7z32"
server_key: "5dfd3e75df5fa43ff51a39534e7df92c"
server_key_iv: "68e75ffb98f513748c165ad8597020b4"
server_key_version: "encryptionkey@0"
I20260811 07:32:34.538750 27914 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:34.566335 27914 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:34.570881 27914 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:34.571171 27914 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:34.572153 27914 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:34.573397 27914 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:34.573486 27914 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:34.573602 27914 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:34.573649 27914 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:34.586892 27914 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:43523
I20260811 07:32:34.586910 28108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:43523 every 8 connection(s)
I20260811 07:32:34.588254 27914 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:34.594566 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 27914
I20260811 07:32:34.594743 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:34.595132 22547 external_mini_cluster.cc:1428] Setting key 77d7145ff5758e15df3013796457d306
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[27340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433554, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:34.609712 27461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:34.591003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:48297 (local address 127.22.4.254:43647)
0811 07:32:34.591235 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:34.591240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:34.592449 (+ 1209us) server_negotiation.cc:407] Connection header received
0811 07:32:34.594277 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:34.594283 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:34.594388 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:34.594562 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:34.596900 (+ 2338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.597642 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.599960 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.600235 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.600350 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:34.604562 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:34.604566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:34.604569 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:34.604613 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:34.606359 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:34.607344 (+ 985us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:34.607348 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:34.607349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:34.607454 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:34.608054 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:34.608057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:34.608059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:34.608289 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:34.608462 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:34.609284 (+ 822us) server_negotiation.cc:299] Negotiation successful
0811 07:32:34.609524 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:32:34.611208 28111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:34.591349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:43647 (local address 127.22.4.195:48297)
0811 07:32:34.592052 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:34.592152 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:34.593827 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:34.595015 (+ 1188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:34.595028 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:34.595660 (+ 632us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:34.596599 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:34.596630 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.597860 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.597863 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:34.599734 (+ 1871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:34.599762 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.600495 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.600499 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:34.600951 (+ 452us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:34.601915 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:34.601939 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:34.604176 (+ 2237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:34.606560 (+ 2384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:34.606568 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:34.606593 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:34.607187 (+ 594us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:34.607571 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:34.607574 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:34.607576 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:34.607824 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:34.608486 (+ 662us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:34.608494 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:34.608903 (+ 409us) client_negotiation.cc:769] Sending connection context
0811 07:32:34.609196 (+ 293us) client_negotiation.cc:240] Negotiation successful
0811 07:32:34.609752 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":183,"threads_started":1}
I20260811 07:32:34.612885 28109 heartbeater.cc:347] Connected to a master server at 127.22.4.254:43647
I20260811 07:32:34.613277 28109 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:34.614009 28109 heartbeater.cc:511] Master 127.22.4.254:43647 requested a full tablet report, sending...
I20260811 07:32:34.615839 27411 ts_manager.cc:194] Registered new tserver with Master: b9f977e3509147e2afb3d25715fefe94 (127.22.4.195:43523)
I20260811 07:32:34.616591 27411 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:48297
I20260811 07:32:34.624336 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[27340](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433554, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[27340](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433554, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:34.662981 27461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:34.651873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44780 (local address 127.22.4.254:43647)
0811 07:32:34.652071 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:34.652075 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:34.652336 (+ 261us) server_negotiation.cc:407] Connection header received
0811 07:32:34.652422 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:34.652424 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:34.652482 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:34.652593 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:34.653548 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.654131 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.655383 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:34.655714 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:34.655838 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:34.659176 (+ 3338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:34.659180 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:34.659182 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:34.659212 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:34.661007 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:34.661496 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:34.661502 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:34.661508 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:34.661588 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:34.661881 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:34.661884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:34.661886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:34.662168 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:34.662323 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:34.662609 (+ 286us) server_negotiation.cc:299] Negotiation successful
0811 07:32:34.662747 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260811 07:32:34.663600 27411 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:44780
I20260811 07:32:34.665246 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 27502
I20260811 07:32:34.690114 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 27710
I20260811 07:32:34.715745 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 27914
I20260811 07:32:34.745883 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 27359
2026-08-11T07:32:34Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2954 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[28127](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[28127](info): set up 2 sockets
Aug 11 07:32:34 dist-test-slave-7z32 krb5kdc[28127](info): commencing operation
krb5kdc: starting...
W20260811 07:32:36.134063 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.350s user 0.002s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:36 dist-test-slave-7z32 krb5kdc[28127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:36.313509 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:41263
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:41263
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:36.467592 28145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:36.468068 28145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:36.468155 28145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:36.472476 28145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:36.472600 28145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:36.472637 28145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:36.472685 28145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:36.472728 28145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:36.480688 28145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:41263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:41263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:36.482340 28145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:36.483817 28145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:36.495028 28155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:36.495028 28156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:36.495311 28145 server_base.cc:1034] running on GCE node
W20260811 07:32:36.495311 28159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:36.496394 28145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:36.497797 28145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:36.499104 28145 hybrid_clock.cc:648] HybridClock initialized: now 1786433556499052 us; error 74 us; skew 500 ppm
Aug 11 07:32:36 dist-test-slave-7z32 krb5kdc[28127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433556, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:36.503062 28145 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:36.504411 28145 webserver.cc:460] Webserver started at http://127.22.4.254:40615/ using document root <none> and password file <none>
I20260811 07:32:36.505196 28145 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:36.505280 28145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:36.505577 28145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:36.508391 28145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "3875b4fcbca54c16bb78684745fbc156"
format_stamp: "Formatted at 2026-08-11 07:32:36 on dist-test-slave-7z32"
server_key: "2fc67995803f15ea263cbf9e8b654010"
server_key_iv: "86c8821d9a9805b3c2405ac052a51f33"
server_key_version: "encryptionkey@0"
I20260811 07:32:36.509133 28145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "3875b4fcbca54c16bb78684745fbc156"
format_stamp: "Formatted at 2026-08-11 07:32:36 on dist-test-slave-7z32"
server_key: "2fc67995803f15ea263cbf9e8b654010"
server_key_iv: "86c8821d9a9805b3c2405ac052a51f33"
server_key_version: "encryptionkey@0"
I20260811 07:32:36.514575 28145 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:36.518677 28167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:36.520720 28145 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:36.520954 28145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "3875b4fcbca54c16bb78684745fbc156"
format_stamp: "Formatted at 2026-08-11 07:32:36 on dist-test-slave-7z32"
server_key: "2fc67995803f15ea263cbf9e8b654010"
server_key_iv: "86c8821d9a9805b3c2405ac052a51f33"
server_key_version: "encryptionkey@0"
I20260811 07:32:36.521109 28145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:36.540342 28145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:36.544610 28145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:36.544895 28145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:36.555150 28145 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:41263
I20260811 07:32:36.555317 28244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:41263 every 8 connection(s)
I20260811 07:32:36.556697 28145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:36.560879 28246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:36.565833 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 28145
I20260811 07:32:36.566013 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:36.566303 22547 external_mini_cluster.cc:1428] Setting key 05ec53bfaa153fc00c1695b4a14f6a3a
I20260811 07:32:36.568212 28246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156: Bootstrap starting.
I20260811 07:32:36.571115 28246 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:36.572048 28246 log.cc:824] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:36.574467 28246 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156: No bootstrap required, opened a new log
Aug 11 07:32:36 dist-test-slave-7z32 krb5kdc[28127](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433556, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:36.579444 28246 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3875b4fcbca54c16bb78684745fbc156" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41263 } }
I20260811 07:32:36.579790 28246 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:36.579869 28246 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3875b4fcbca54c16bb78684745fbc156, State: Initialized, Role: FOLLOWER
I20260811 07:32:36.580905 28246 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3875b4fcbca54c16bb78684745fbc156" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41263 } }
I20260811 07:32:36.581128 28246 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:36.581219 28246 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:36.581358 28246 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:36.582564 28246 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3875b4fcbca54c16bb78684745fbc156" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41263 } }
I20260811 07:32:36.583106 28246 leader_election.cc:302] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3875b4fcbca54c16bb78684745fbc156; no voters:
I20260811 07:32:36.583601 28246 leader_election.cc:288] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:36.583961 28253 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:36.584281 28253 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [term 1 LEADER]: Becoming Leader. State: Replica: 3875b4fcbca54c16bb78684745fbc156, State: Running, Role: LEADER
I20260811 07:32:36.584779 28253 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3875b4fcbca54c16bb78684745fbc156" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41263 } }
I20260811 07:32:36.585395 28246 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:36.587942 28258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3875b4fcbca54c16bb78684745fbc156. Latest consensus state: current_term: 1 leader_uuid: "3875b4fcbca54c16bb78684745fbc156" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3875b4fcbca54c16bb78684745fbc156" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41263 } } }
I20260811 07:32:36.588225 28258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:36.587942 28255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3875b4fcbca54c16bb78684745fbc156" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3875b4fcbca54c16bb78684745fbc156" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41263 } } }
I20260811 07:32:36.589855 28255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:36.589319 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:36.568452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33684 (local address 127.22.4.254:41263)
0811 07:32:36.569153 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:36.569178 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:36.569240 (+ 62us) server_negotiation.cc:407] Connection header received
0811 07:32:36.570208 (+ 968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:36.570238 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:36.570736 (+ 498us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:36.571339 (+ 603us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:36.572436 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:36.573575 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:36.574533 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:36.575270 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:36.575478 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:36.579313 (+ 3835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:36.579322 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:36.579348 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:36.579408 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:36.582194 (+ 2786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:36.583039 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:36.583049 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:36.583059 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:36.583351 (+ 292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:36.583867 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:36.583873 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:36.583878 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:36.584542 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:36.584781 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:36.585597 (+ 816us) server_negotiation.cc:299] Negotiation successful
0811 07:32:36.586090 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":199,"threads_started":1}
W20260811 07:32:36.592274 28277 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:36.592438 28277 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:36.592525 28279 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:36.593340 28279 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:36.602155 28279 catalog_manager.cc:1347] Generated new cluster ID: 575feee627094139a14846a068b38c3b
I20260811 07:32:36.602267 28279 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:36.610996 28279 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:36.612190 28279 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:36.622551 28279 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3875b4fcbca54c16bb78684745fbc156: Generated new TSK 0
I20260811 07:32:36.623711 28279 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:36.671056 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:41263
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:36.807991 28289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:36.808327 28289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:36.808377 28289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:36.812781 28289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:36.812870 28289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:36.812933 28289 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:36.818943 28289 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:41263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:36.820345 28289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:36.821585 28289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:36.834934 28302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:36.834975 28298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:36.834934 28299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:36.835340 28289 server_base.cc:1034] running on GCE node
I20260811 07:32:36.835973 28289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:36.836839 28289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:36.838079 28289 hybrid_clock.cc:648] HybridClock initialized: now 1786433556838061 us; error 41 us; skew 500 ppm
Aug 11 07:32:36 dist-test-slave-7z32 krb5kdc[28127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433556, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:36.847076 28289 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:36.848392 28289 webserver.cc:460] Webserver started at http://127.22.4.193:38463/ using document root <none> and password file <none>
I20260811 07:32:36.849089 28289 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:36.849164 28289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:36.849368 28289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:36.851910 28289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "a34dd708860f4dbc9ae1937b95a61bb3"
format_stamp: "Formatted at 2026-08-11 07:32:36 on dist-test-slave-7z32"
server_key: "f2e6767f8bdc5d3baeaf7eeb9969e808"
server_key_iv: "93ab5ed2f4ac3237545c721bb97dc170"
server_key_version: "encryptionkey@0"
I20260811 07:32:36.852542 28289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "a34dd708860f4dbc9ae1937b95a61bb3"
format_stamp: "Formatted at 2026-08-11 07:32:36 on dist-test-slave-7z32"
server_key: "f2e6767f8bdc5d3baeaf7eeb9969e808"
server_key_iv: "93ab5ed2f4ac3237545c721bb97dc170"
server_key_version: "encryptionkey@0"
I20260811 07:32:36.857812 28289 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260811 07:32:36.861073 28310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:36.862619 28289 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:36.862762 28289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "a34dd708860f4dbc9ae1937b95a61bb3"
format_stamp: "Formatted at 2026-08-11 07:32:36 on dist-test-slave-7z32"
server_key: "f2e6767f8bdc5d3baeaf7eeb9969e808"
server_key_iv: "93ab5ed2f4ac3237545c721bb97dc170"
server_key_version: "encryptionkey@0"
I20260811 07:32:36.862979 28289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:36.889468 28289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:36.893267 28289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:36.893452 28289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:36.894078 28289 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:36.895218 28289 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:36.895282 28289 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:36.895336 28289 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:36.895398 28289 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:36.907090 28289 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:42115
I20260811 07:32:36.907116 28488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:42115 every 8 connection(s)
I20260811 07:32:36.908231 28289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:36.912127 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 28289
I20260811 07:32:36.912317 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:36.912714 22547 external_mini_cluster.cc:1428] Setting key d8cc5c55a1f67711848554c1b343c222
Aug 11 07:32:36 dist-test-slave-7z32 krb5kdc[28127](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433556, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:32:36.928400 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:36.911161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:45991 (local address 127.22.4.254:41263)
0811 07:32:36.911403 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:36.911410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:36.912999 (+ 1589us) server_negotiation.cc:407] Connection header received
0811 07:32:36.914957 (+ 1958us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:36.914961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:36.915022 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:36.915115 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:36.916490 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:36.917044 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:36.918937 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:36.919284 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:36.919449 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:36.923668 (+ 4219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:36.923673 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:36.923675 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:36.923723 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:36.925605 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:36.926386 (+ 781us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:36.926391 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:36.926393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:36.926528 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:36.927031 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:36.927034 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:36.927036 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:36.927284 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:36.927377 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:36.928073 (+ 696us) server_negotiation.cc:299] Negotiation successful
0811 07:32:36.928235 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:32:36.929474 28493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:36.911828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:41263 (local address 127.22.4.193:45991)
0811 07:32:36.912719 (+ 891us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:36.912823 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:36.914642 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:36.915354 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:36.915362 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:36.915772 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:36.916319 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:36.916333 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:36.917189 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:36.917198 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:36.918553 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:36.918570 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:36.919540 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:36.919549 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:36.919807 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:36.920654 (+ 847us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:36.920683 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:36.923297 (+ 2614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:36.925791 (+ 2494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:36.925803 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:36.925825 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:36.926217 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:36.926667 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:36.926673 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:36.926678 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:36.926928 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:36.927424 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:36.927434 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:36.927786 (+ 352us) client_negotiation.cc:769] Sending connection context
0811 07:32:36.927973 (+ 187us) client_negotiation.cc:240] Negotiation successful
0811 07:32:36.928282 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":180,"threads_started":1}
I20260811 07:32:36.931542 28489 heartbeater.cc:347] Connected to a master server at 127.22.4.254:41263
I20260811 07:32:36.931890 28489 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:36.932633 28489 heartbeater.cc:511] Master 127.22.4.254:41263 requested a full tablet report, sending...
I20260811 07:32:36.934504 28187 ts_manager.cc:194] Registered new tserver with Master: a34dd708860f4dbc9ae1937b95a61bb3 (127.22.4.193:42115)
I20260811 07:32:36.936444 28187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:45991
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:36.957361 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:41263
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:37.095187 28498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:37.095587 28498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:37.095666 28498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:37.100641 28498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:37.100802 28498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:37.100906 28498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:37.107887 28498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:41263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:37.109228 28498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:37.110455 28498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:37.123142 28504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:37.123152 28510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:37.123112 28507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:37.123468 28498 server_base.cc:1034] running on GCE node
I20260811 07:32:37.124330 28498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:37.125562 28498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:37.126889 28498 hybrid_clock.cc:648] HybridClock initialized: now 1786433557126785 us; error 67 us; skew 500 ppm
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433557, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:37.131994 28498 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:37.133477 28498 webserver.cc:460] Webserver started at http://127.22.4.194:37765/ using document root <none> and password file <none>
I20260811 07:32:37.134282 28498 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:37.134362 28498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:37.134603 28498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:37.137530 28498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "5963681654ed44bb9a859733307a0a48"
format_stamp: "Formatted at 2026-08-11 07:32:37 on dist-test-slave-7z32"
server_key: "e6bb72e3d24b642d846d6aa10eb0c48e"
server_key_iv: "b9c24f23680885aea672eb331088ea11"
server_key_version: "encryptionkey@0"
I20260811 07:32:37.138245 28498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "5963681654ed44bb9a859733307a0a48"
format_stamp: "Formatted at 2026-08-11 07:32:37 on dist-test-slave-7z32"
server_key: "e6bb72e3d24b642d846d6aa10eb0c48e"
server_key_iv: "b9c24f23680885aea672eb331088ea11"
server_key_version: "encryptionkey@0"
I20260811 07:32:37.144066 28498 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260811 07:32:37.147969 28518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:37.149933 28498 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:37.150175 28498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "5963681654ed44bb9a859733307a0a48"
format_stamp: "Formatted at 2026-08-11 07:32:37 on dist-test-slave-7z32"
server_key: "e6bb72e3d24b642d846d6aa10eb0c48e"
server_key_iv: "b9c24f23680885aea672eb331088ea11"
server_key_version: "encryptionkey@0"
I20260811 07:32:37.150331 28498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:37.173740 28498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:37.178038 28498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:37.178282 28498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:37.179137 28498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:37.180574 28498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:37.180691 28498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:37.180821 28498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:37.180863 28498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:37.194414 28498 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:40795
I20260811 07:32:37.194474 28717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:40795 every 8 connection(s)
I20260811 07:32:37.195779 28498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:37.200428 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 28498
I20260811 07:32:37.200608 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:37.201102 22547 external_mini_cluster.cc:1428] Setting key cc9158c9f8614e07ae47408b249aeea4
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28127](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433557, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:37.218568 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:37.198496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:34727 (local address 127.22.4.254:41263)
0811 07:32:37.198810 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:37.198815 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:37.200157 (+ 1342us) server_negotiation.cc:407] Connection header received
0811 07:32:37.202698 (+ 2541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:37.202703 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:37.202783 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:37.202927 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:37.204772 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.205426 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.207100 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.207487 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.207872 (+ 385us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:37.212419 (+ 4547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:37.212425 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:37.212427 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:37.212468 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:37.214623 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:37.215820 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:37.215824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:37.215826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:37.215978 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:37.216626 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:37.216630 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:37.216631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:37.216915 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:37.217021 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:37.218147 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0811 07:32:37.218400 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 07:32:37.219792 28725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:37.198815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:41263 (local address 127.22.4.194:34727)
0811 07:32:37.199881 (+ 1066us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:37.199966 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:37.202358 (+ 2392us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:37.203273 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:37.203283 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:37.203838 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:37.204541 (+ 703us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:37.204560 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.205606 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.205615 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:37.206697 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:37.206710 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.207976 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.207982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:37.208216 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:37.209144 (+ 928us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:37.209164 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:37.212010 (+ 2846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:37.214894 (+ 2884us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:37.214907 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:37.214939 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:37.215593 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:37.216132 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:37.216136 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:37.216140 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:37.216441 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:37.217122 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:37.217131 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:37.217679 (+ 548us) client_negotiation.cc:769] Sending connection context
0811 07:32:37.217939 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 07:32:37.218396 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":177,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:32:37.221776 28718 heartbeater.cc:347] Connected to a master server at 127.22.4.254:41263
I20260811 07:32:37.222223 28718 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:37.223253 28718 heartbeater.cc:511] Master 127.22.4.254:41263 requested a full tablet report, sending...
I20260811 07:32:37.225565 28187 ts_manager.cc:194] Registered new tserver with Master: 5963681654ed44bb9a859733307a0a48 (127.22.4.194:40795)
I20260811 07:32:37.226635 28187 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:34727
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:37.243754 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:41263
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:35155
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:37.374138 28730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:37.374501 28730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:37.374585 28730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:37.378876 28730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:37.378998 28730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:37.379102 28730 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:37.384879 28730 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:35155
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:41263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:37.386278 28730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:37.387586 28730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:37.399535 28737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:37.399605 28740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:37.399559 28730 server_base.cc:1034] running on GCE node
W20260811 07:32:37.399461 28738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:37.400535 28730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:37.401472 28730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:37.402920 28730 hybrid_clock.cc:648] HybridClock initialized: now 1786433557402865 us; error 69 us; skew 500 ppm
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433557, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:37.406929 28730 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:37.408183 28730 webserver.cc:460] Webserver started at http://127.22.4.195:38909/ using document root <none> and password file <none>
I20260811 07:32:37.408967 28730 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:37.409085 28730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:37.409408 28730 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:37.412079 28730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "c3da9f38f7f84aaca6f6717a97c0445b"
format_stamp: "Formatted at 2026-08-11 07:32:37 on dist-test-slave-7z32"
server_key: "0b93a2fdad3a1b61cc9db23923849a4a"
server_key_iv: "5747cd2bd7f8c88c28a2f034bedb2d64"
server_key_version: "encryptionkey@0"
I20260811 07:32:37.412806 28730 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "c3da9f38f7f84aaca6f6717a97c0445b"
format_stamp: "Formatted at 2026-08-11 07:32:37 on dist-test-slave-7z32"
server_key: "0b93a2fdad3a1b61cc9db23923849a4a"
server_key_iv: "5747cd2bd7f8c88c28a2f034bedb2d64"
server_key_version: "encryptionkey@0"
I20260811 07:32:37.417829 28730 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:32:37.421415 28750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:37.423388 28730 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:37.423588 28730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "c3da9f38f7f84aaca6f6717a97c0445b"
format_stamp: "Formatted at 2026-08-11 07:32:37 on dist-test-slave-7z32"
server_key: "0b93a2fdad3a1b61cc9db23923849a4a"
server_key_iv: "5747cd2bd7f8c88c28a2f034bedb2d64"
server_key_version: "encryptionkey@0"
I20260811 07:32:37.423736 28730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:37.439525 28730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:37.443725 28730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:37.443982 28730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:37.444689 28730 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:37.445742 28730 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:37.445835 28730 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:37.445919 28730 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:37.445966 28730 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:37.457829 28730 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:45029
I20260811 07:32:37.457842 28939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:45029 every 8 connection(s)
I20260811 07:32:37.459034 28730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:37.465693 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 28730
I20260811 07:32:37.465888 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:37.466243 22547 external_mini_cluster.cc:1428] Setting key 21b988d78710314be6b7981309aeb060
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28127](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433557, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:37.477902 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:37.461986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:39049 (local address 127.22.4.254:41263)
0811 07:32:37.462227 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:37.462232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:37.463529 (+ 1297us) server_negotiation.cc:407] Connection header received
0811 07:32:37.465136 (+ 1607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:37.465141 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:37.465225 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:37.465356 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:37.467243 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.468059 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.469752 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.469986 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.470093 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:37.473301 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:37.473305 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:37.473307 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:37.473348 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:37.475209 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:37.475828 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:37.475832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:37.475833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:37.475927 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:37.476427 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:37.476431 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:37.476432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:37.476712 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:37.476821 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:37.477552 (+ 731us) server_negotiation.cc:299] Negotiation successful
0811 07:32:37.477726 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 07:32:37.478942 28943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:37.462481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:41263 (local address 127.22.4.195:39049)
0811 07:32:37.463235 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:37.463363 (+ 128us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:37.464838 (+ 1475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:37.465654 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:37.465665 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:37.466323 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:37.467049 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:37.467085 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.468202 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.468207 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:37.469619 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:37.469630 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.470188 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.470191 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:37.470390 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:37.471145 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:37.471163 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:37.473065 (+ 1902us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:37.475363 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:37.475369 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:37.475384 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:37.475694 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:37.476052 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:37.476055 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:37.476057 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:37.476228 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:37.476894 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:37.476900 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:37.477214 (+ 314us) client_negotiation.cc:769] Sending connection context
0811 07:32:37.477416 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 07:32:37.477738 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":168,"threads_started":1}
I20260811 07:32:37.480954 28941 heartbeater.cc:347] Connected to a master server at 127.22.4.254:41263
I20260811 07:32:37.481281 28941 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:37.481894 28941 heartbeater.cc:511] Master 127.22.4.254:41263 requested a full tablet report, sending...
I20260811 07:32:37.483615 28184 ts_manager.cc:194] Registered new tserver with Master: c3da9f38f7f84aaca6f6717a97c0445b (127.22.4.195:45029)
I20260811 07:32:37.484409 28184 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:39049
I20260811 07:32:37.497074 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28127](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28127](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:37.535233 28950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:37.522044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46030 (local address 127.22.4.193:42115)
0811 07:32:37.522546 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:37.522554 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:37.522590 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:32:37.522653 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:37.522659 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:37.523033 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:37.523192 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:37.524226 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.525101 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.526351 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.527016 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.527135 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:37.530725 (+ 3590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:37.530738 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:37.530755 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:37.530789 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:37.533008 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:37.533546 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:37.533560 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:37.533561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:37.533653 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:37.533969 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:37.533972 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:37.533974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:37.534286 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:37.534538 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:37.534778 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 07:32:37.535051 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":160,"threads_started":1}
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28127](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:37.551455 28251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:37.540183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33700 (local address 127.22.4.254:41263)
0811 07:32:37.540403 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:37.540410 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:37.540431 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:32:37.540503 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:37.540506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:37.540555 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:37.540716 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:37.541503 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.542203 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.543162 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:37.543405 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:37.543519 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:37.547265 (+ 3746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:37.547270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:37.547273 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:37.547368 (+ 95us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:37.549331 (+ 1963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:37.549862 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:37.549865 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:37.549866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:37.549962 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:37.550315 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:37.550318 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:37.550320 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:37.550614 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:37.550768 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:37.551148 (+ 380us) server_negotiation.cc:299] Negotiation successful
0811 07:32:37.551288 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 07:32:37.552116 28184 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33700
I20260811 07:32:37.552918 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 28289
I20260811 07:32:37.593119 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 28498
I20260811 07:32:37.614357 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 28730
I20260811 07:32:37.630564 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 28145
2026-08-11T07:32:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2881 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28958](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28958](info): set up 2 sockets
Aug 11 07:32:37 dist-test-slave-7z32 krb5kdc[28958](info): commencing operation
krb5kdc: starting...
W20260811 07:32:38.969991 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.304s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:39 dist-test-slave-7z32 krb5kdc[28958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:39.140097 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:36023
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:36023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:39.272125 28978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:39.272727 28978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:39.272863 28978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:39.277426 28978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:39.277558 28978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:39.277597 28978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:39.277637 28978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:39.277676 28978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:39.283823 28978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:36023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:36023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:39.285175 28978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:39.286350 28978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:39.297541 28989 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:39.297541 28991 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:39.297582 28988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:39.297959 28978 server_base.cc:1034] running on GCE node
I20260811 07:32:39.298779 28978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:39.300241 28978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:39.303664 28978 hybrid_clock.cc:648] HybridClock initialized: now 1786433559303624 us; error 51 us; skew 500 ppm
Aug 11 07:32:39 dist-test-slave-7z32 krb5kdc[28958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433559, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:39.307895 28978 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:39.309113 28978 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:39.309248 28978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:39.309533 28978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:39.312175 28978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "b81599c1d17e4dacb952a24fa5262234"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "a21f40b47a887aa8c319a90a00fe155b"
server_key_iv: "35e731c3fdc5b03f434f7389a051fb43"
server_key_version: "encryptionkey@0"
I20260811 07:32:39.312901 28978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "b81599c1d17e4dacb952a24fa5262234"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "a21f40b47a887aa8c319a90a00fe155b"
server_key_iv: "35e731c3fdc5b03f434f7389a051fb43"
server_key_version: "encryptionkey@0"
I20260811 07:32:39.318063 28978 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:32:39.321774 29000 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:39.324625 28978 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:32:39.325101 28978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b81599c1d17e4dacb952a24fa5262234"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "a21f40b47a887aa8c319a90a00fe155b"
server_key_iv: "35e731c3fdc5b03f434f7389a051fb43"
server_key_version: "encryptionkey@0"
I20260811 07:32:39.325314 28978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:39.352474 28978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:39.357095 28978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:39.357388 28978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:39.366503 28978 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:36023
I20260811 07:32:39.366947 29088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:36023 every 8 connection(s)
I20260811 07:32:39.367467 28978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:39.371523 29092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:39.372517 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 28978
I20260811 07:32:39.372715 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:39.373092 22547 external_mini_cluster.cc:1428] Setting key 88356a9e50a25082e93383202ad43f71
I20260811 07:32:39.381173 29092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234: Bootstrap starting.
I20260811 07:32:39.385730 29092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234: Neither blocks nor log segments found. Creating new log.
Aug 11 07:32:39 dist-test-slave-7z32 krb5kdc[28958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433559, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:39.386966 29092 log.cc:824] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:39.390686 29092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234: No bootstrap required, opened a new log
I20260811 07:32:39.394265 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:39.375231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49662 (local address 127.22.4.254:36023)
0811 07:32:39.375837 (+ 606us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:39.375854 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:39.375905 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:32:39.376962 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:39.376995 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:39.377509 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:39.377913 (+ 404us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:39.379209 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:39.380503 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:39.382086 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:39.382955 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:39.383161 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:39.387343 (+ 4182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:39.387354 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:39.387382 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:39.387430 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:39.389829 (+ 2399us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:39.390540 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:39.390548 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:39.390555 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:39.390737 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:39.391231 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:39.391237 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:39.391240 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:39.391883 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:39.392124 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:39.392494 (+ 370us) server_negotiation.cc:299] Negotiation successful
0811 07:32:39.392887 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":399,"thread_start_us":199,"threads_started":1}
I20260811 07:32:39.396212 29092 raft_consensus.cc:348] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81599c1d17e4dacb952a24fa5262234" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36023 } }
I20260811 07:32:39.396579 29092 raft_consensus.cc:374] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:39.396690 29092 raft_consensus.cc:729] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81599c1d17e4dacb952a24fa5262234, State: Initialized, Role: FOLLOWER
I20260811 07:32:39.397264 29092 consensus_queue.cc:260] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81599c1d17e4dacb952a24fa5262234" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36023 } }
I20260811 07:32:39.397418 29092 raft_consensus.cc:388] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:39.397466 29092 raft_consensus.cc:482] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:39.397543 29092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:39.399047 29092 raft_consensus.cc:504] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81599c1d17e4dacb952a24fa5262234" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36023 } }
I20260811 07:32:39.399839 29092 leader_election.cc:302] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b81599c1d17e4dacb952a24fa5262234; no voters:
I20260811 07:32:39.400454 29092 leader_election.cc:288] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:39.400727 29097 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:39.401378 29097 raft_consensus.cc:686] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [term 1 LEADER]: Becoming Leader. State: Replica: b81599c1d17e4dacb952a24fa5262234, State: Running, Role: LEADER
I20260811 07:32:39.401938 29097 consensus_queue.cc:237] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81599c1d17e4dacb952a24fa5262234" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36023 } }
I20260811 07:32:39.402632 29092 sys_catalog.cc:564] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:39.404335 29101 sys_catalog.cc:455] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b81599c1d17e4dacb952a24fa5262234. Latest consensus state: current_term: 1 leader_uuid: "b81599c1d17e4dacb952a24fa5262234" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81599c1d17e4dacb952a24fa5262234" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36023 } } }
I20260811 07:32:39.404354 29100 sys_catalog.cc:455] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b81599c1d17e4dacb952a24fa5262234" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81599c1d17e4dacb952a24fa5262234" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36023 } } }
I20260811 07:32:39.404552 29100 sys_catalog.cc:458] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:39.404552 29101 sys_catalog.cc:458] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:39.405622 29108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:39.409387 29108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:39.416742 29108 catalog_manager.cc:1347] Generated new cluster ID: 17dcd3f1e6f14206b2063b7c29118430
I20260811 07:32:39.416889 29108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:39.460644 29108 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:39.461895 29108 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:39.469450 29108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234: Generated new TSK 0
I20260811 07:32:39.470260 29108 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:39.523376 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36023
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:39.667263 29128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:39.667603 29128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:39.667654 29128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:39.672014 29128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:39.672106 29128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:39.672173 29128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:39.677858 29128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:39.679224 29128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:39.680368 29128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:39.692610 29134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:39.692826 29135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:39.692866 29137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:39.692981 29128 server_base.cc:1034] running on GCE node
I20260811 07:32:39.694336 29128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:39.695454 29128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:39.696765 29128 hybrid_clock.cc:648] HybridClock initialized: now 1786433559696725 us; error 65 us; skew 500 ppm
Aug 11 07:32:39 dist-test-slave-7z32 krb5kdc[28958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433559, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:39.701128 29128 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:39.702455 29128 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:39.702595 29128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:39.703079 29128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:39.706593 29128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "af6a6ef9ced5417fbc364815aec5d3e7"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "5a802fa3366201854dc3024f8f56c465"
server_key_iv: "b8085072caff9c1b89efdd8ea27f60ce"
server_key_version: "encryptionkey@0"
I20260811 07:32:39.707829 29128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "af6a6ef9ced5417fbc364815aec5d3e7"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "5a802fa3366201854dc3024f8f56c465"
server_key_iv: "b8085072caff9c1b89efdd8ea27f60ce"
server_key_version: "encryptionkey@0"
I20260811 07:32:39.713712 29128 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:32:39.718098 29151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:39.720609 29128 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:39.720826 29128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "af6a6ef9ced5417fbc364815aec5d3e7"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "5a802fa3366201854dc3024f8f56c465"
server_key_iv: "b8085072caff9c1b89efdd8ea27f60ce"
server_key_version: "encryptionkey@0"
I20260811 07:32:39.720990 29128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:39.746876 29128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:39.751389 29128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:39.751613 29128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:39.752489 29128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:39.753743 29128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:39.753803 29128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:39.753860 29128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:39.753880 29128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:39.768229 29128 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:37125
I20260811 07:32:39.768319 29312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:37125 every 8 connection(s)
I20260811 07:32:39.769150 29128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:39.776870 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 29128
I20260811 07:32:39.777057 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:39.777437 22547 external_mini_cluster.cc:1428] Setting key 70aa05891c482baf67e92865a57cee4f
Aug 11 07:32:39 dist-test-slave-7z32 krb5kdc[28958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433559, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:39.790392 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:39.771714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:48545 (local address 127.22.4.254:36023)
0811 07:32:39.771947 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:39.771953 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:39.773022 (+ 1069us) server_negotiation.cc:407] Connection header received
0811 07:32:39.775065 (+ 2043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:39.775070 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:39.775155 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:39.775255 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:39.777323 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:39.778062 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:39.780056 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:39.780316 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:39.780460 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:39.784789 (+ 4329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:39.784793 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:39.784795 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:39.784831 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:39.786811 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:39.787972 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:39.787976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:39.787977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:39.788079 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:39.788683 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:39.788686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:39.788687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:39.788905 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:39.788996 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:39.790103 (+ 1107us) server_negotiation.cc:299] Negotiation successful
0811 07:32:39.790252 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 07:32:39.792359 29316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:39.772068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36023 (local address 127.22.4.193:48545)
0811 07:32:39.772770 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:39.772840 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:39.774693 (+ 1853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:39.775516 (+ 823us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:39.775526 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:39.776095 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:39.776943 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:39.776975 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:39.778323 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:39.778327 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:39.779876 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:39.779890 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:39.780555 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:39.780562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:39.780862 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:39.781758 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:39.781790 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:39.784419 (+ 2629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:39.787090 (+ 2671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:39.787105 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:39.787138 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:39.787784 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:39.788212 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:39.788216 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:39.788218 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:39.788543 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:39.789065 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:39.789079 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:39.789682 (+ 603us) client_negotiation.cc:769] Sending connection context
0811 07:32:39.790031 (+ 349us) client_negotiation.cc:240] Negotiation successful
0811 07:32:39.790633 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":160,"threads_started":1}
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:32:39.794456 29313 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36023
I20260811 07:32:39.794926 29313 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:39.795629 29313 heartbeater.cc:511] Master 127.22.4.254:36023 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:32:39.797880 29018 ts_manager.cc:194] Registered new tserver with Master: af6a6ef9ced5417fbc364815aec5d3e7 (127.22.4.193:37125)
I20260811 07:32:39.799274 29018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:48545
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:39.823416 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36023
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:39.951933 29320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:39.952258 29320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:39.952347 29320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:39.956588 29320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:39.956674 29320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:39.956739 29320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:39.962436 29320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:39.963811 29320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:39.964967 29320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:39.977461 29329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:39.977581 29320 server_base.cc:1034] running on GCE node
W20260811 07:32:39.977620 29331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:39.977620 29328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:39.978382 29320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:39.979316 29320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:39.983006 29320 hybrid_clock.cc:648] HybridClock initialized: now 1786433559982812 us; error 206 us; skew 500 ppm
Aug 11 07:32:39 dist-test-slave-7z32 krb5kdc[28958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433559, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:39.987545 29320 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:39.988819 29320 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:39.988950 29320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:39.989275 29320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:39.992293 29320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "d15736d9179d4e6e841ee947babac134"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "1f912b0a7b3ed200e8fca21e6cb3566d"
server_key_iv: "486a6fc4bac494d8f9654284a8e13f8c"
server_key_version: "encryptionkey@0"
I20260811 07:32:39.993044 29320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "d15736d9179d4e6e841ee947babac134"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "1f912b0a7b3ed200e8fca21e6cb3566d"
server_key_iv: "486a6fc4bac494d8f9654284a8e13f8c"
server_key_version: "encryptionkey@0"
I20260811 07:32:39.998499 29320 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260811 07:32:40.003175 29339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:40.005937 29320 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:32:40.006196 29320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "d15736d9179d4e6e841ee947babac134"
format_stamp: "Formatted at 2026-08-11 07:32:39 on dist-test-slave-7z32"
server_key: "1f912b0a7b3ed200e8fca21e6cb3566d"
server_key_iv: "486a6fc4bac494d8f9654284a8e13f8c"
server_key_version: "encryptionkey@0"
I20260811 07:32:40.006412 29320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:40.021885 29320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:40.026875 29320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:40.027168 29320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:40.027944 29320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:40.029055 29320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:40.029119 29320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:40.029210 29320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:40.029281 29320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:40.041710 29320 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:42253
I20260811 07:32:40.041802 29504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:42253 every 8 connection(s)
I20260811 07:32:40.042565 29320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:40.044449 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 29320
I20260811 07:32:40.044566 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:40.044955 22547 external_mini_cluster.cc:1428] Setting key 35bb01205114f82ac2d6883446997c47
Aug 11 07:32:40 dist-test-slave-7z32 krb5kdc[28958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433559, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:32:40.065220 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.045753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:51321 (local address 127.22.4.254:36023)
0811 07:32:40.046035 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.046041 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.047135 (+ 1094us) server_negotiation.cc:407] Connection header received
0811 07:32:40.049027 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.049031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.049115 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.049220 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:40.051773 (+ 2553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.052480 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.054942 (+ 2462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.055223 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.055414 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.059910 (+ 4496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:40.059914 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:40.059916 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:40.059955 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:40.061708 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:40.062380 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:40.062386 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:40.062391 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:40.062491 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:40.062995 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:40.062998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:40.063000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:40.063290 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:40.063437 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.064721 (+ 1284us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.064903 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 07:32:40.067631 29508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.046080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36023 (local address 127.22.4.194:51321)
0811 07:32:40.046875 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:40.046965 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:40.048719 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:40.049519 (+ 800us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:40.049536 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:40.050348 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:40.051412 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.051445 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.052712 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.052719 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.054645 (+ 1926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.054666 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.055530 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.055536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.055903 (+ 367us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.056894 (+ 991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:40.056934 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:40.059622 (+ 2688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:40.061867 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:40.061876 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:40.061900 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:40.062251 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:40.062631 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:40.062634 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:40.062637 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:40.062812 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:40.063619 (+ 807us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:40.063636 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:40.064265 (+ 629us) client_negotiation.cc:769] Sending connection context
0811 07:32:40.064577 (+ 312us) client_negotiation.cc:240] Negotiation successful
0811 07:32:40.065037 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":160,"threads_started":1}
I20260811 07:32:40.069670 29506 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36023
I20260811 07:32:40.070050 29506 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:40.070730 29506 heartbeater.cc:511] Master 127.22.4.254:36023 requested a full tablet report, sending...
I20260811 07:32:40.072678 29018 ts_manager.cc:194] Registered new tserver with Master: d15736d9179d4e6e841ee947babac134 (127.22.4.194:42253)
I20260811 07:32:40.073704 29018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:51321
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:40.087743 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36023
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:40.237069 29513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:40.237473 29513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:40.237530 29513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:40.242062 29513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:40.242177 29513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:40.242254 29513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:40.248766 29513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:40.250396 29513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:40.252028 29513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:40.265868 29528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:40.265925 29520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:40.266155 29513 server_base.cc:1034] running on GCE node
W20260811 07:32:40.266284 29519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:40.267051 29513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:40.268189 29513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:40.269524 29513 hybrid_clock.cc:648] HybridClock initialized: now 1786433560269440 us; error 67 us; skew 500 ppm
Aug 11 07:32:40 dist-test-slave-7z32 krb5kdc[28958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433560, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:40.273283 29513 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:40.274259 29513 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:40.274369 29513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:40.274706 29513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:40.277206 29513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "2c3a728ec1b746bb9c6422848a4c09bb"
format_stamp: "Formatted at 2026-08-11 07:32:40 on dist-test-slave-7z32"
server_key: "d16596c4f7174105912fa2a46c684bc0"
server_key_iv: "a3a64b743aca76a5716feb1865145e0c"
server_key_version: "encryptionkey@0"
I20260811 07:32:40.277902 29513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "2c3a728ec1b746bb9c6422848a4c09bb"
format_stamp: "Formatted at 2026-08-11 07:32:40 on dist-test-slave-7z32"
server_key: "d16596c4f7174105912fa2a46c684bc0"
server_key_iv: "a3a64b743aca76a5716feb1865145e0c"
server_key_version: "encryptionkey@0"
I20260811 07:32:40.282689 29513 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:32:40.286194 29537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:40.288460 29513 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:40.288690 29513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "2c3a728ec1b746bb9c6422848a4c09bb"
format_stamp: "Formatted at 2026-08-11 07:32:40 on dist-test-slave-7z32"
server_key: "d16596c4f7174105912fa2a46c684bc0"
server_key_iv: "a3a64b743aca76a5716feb1865145e0c"
server_key_version: "encryptionkey@0"
I20260811 07:32:40.288853 29513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:40.327811 29513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:40.333670 29513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:40.333994 29513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:40.335045 29513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:40.336666 29513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:40.336735 29513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:40.336793 29513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:40.336809 29513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:40.350087 29513 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:42417
I20260811 07:32:40.350145 29723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:42417 every 8 connection(s)
I20260811 07:32:40.351138 29513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:40.360231 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 29513
I20260811 07:32:40.360479 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:40.360864 22547 external_mini_cluster.cc:1428] Setting key fb4fbceedd3d6b2fbb05888e464261ea
Aug 11 07:32:40 dist-test-slave-7z32 krb5kdc[28958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433560, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:40.370074 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.353649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:38547 (local address 127.22.4.254:36023)
0811 07:32:40.353922 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.353938 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.354974 (+ 1036us) server_negotiation.cc:407] Connection header received
0811 07:32:40.356757 (+ 1783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.356761 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.356837 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.356963 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:40.358564 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.359266 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.360711 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.361124 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.361342 (+ 218us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.364967 (+ 3625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:40.364971 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:40.364974 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:40.365011 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:40.366943 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:40.367956 (+ 1013us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:40.367960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:40.367962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:40.368107 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:40.368638 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:40.368642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:40.368643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:40.368905 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:40.368998 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.369745 (+ 747us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.369909 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260811 07:32:40.371204 29729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.353990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36023 (local address 127.22.4.195:38547)
0811 07:32:40.354681 (+ 691us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:40.354747 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:40.356474 (+ 1727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:40.357208 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:40.357218 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:40.357712 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:40.358382 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.358406 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.359420 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.359424 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.360449 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.360489 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.361428 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.361433 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.361741 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.362752 (+ 1011us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:40.362851 (+ 99us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:40.364732 (+ 1881us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:40.367107 (+ 2375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:40.367115 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:40.367133 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:40.367618 (+ 485us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:40.368234 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:40.368238 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:40.368239 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:40.368443 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:40.369034 (+ 591us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:40.369041 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:40.369397 (+ 356us) client_negotiation.cc:769] Sending connection context
0811 07:32:40.369624 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 07:32:40.370022 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":190,"threads_started":1}
I20260811 07:32:40.372783 29724 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36023
I20260811 07:32:40.373246 29724 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:40.373993 29724 heartbeater.cc:511] Master 127.22.4.254:36023 requested a full tablet report, sending...
I20260811 07:32:40.375820 29018 ts_manager.cc:194] Registered new tserver with Master: 2c3a728ec1b746bb9c6422848a4c09bb (127.22.4.195:42417)
I20260811 07:32:40.376559 29018 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:38547
I20260811 07:32:40.377880 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:32:40.391252 29095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.380681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49678 (local address 127.22.4.254:36023)
0811 07:32:40.380855 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.380861 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.381142 (+ 281us) server_negotiation.cc:407] Connection header received
0811 07:32:40.381265 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.381268 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.381394 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.381489 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:40.382460 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.383097 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.384212 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.384457 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.384553 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.386364 (+ 1811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:40.386368 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:40.386370 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:40.386401 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:40.388527 (+ 2126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:40.389174 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:40.389178 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:40.389179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:40.389290 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:40.389843 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:40.389846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:40.389848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:40.390185 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:40.390345 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.390819 (+ 474us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.391102 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:32:40.396378 29018 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49678:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:40.401087 29018 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:40.423236 29744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.415330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41512 (local address 127.22.4.195:42417)
0811 07:32:40.416031 (+ 701us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.416047 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.417118 (+ 1071us) server_negotiation.cc:407] Connection header received
0811 07:32:40.417493 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.417501 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.417723 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.417924 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:40.418813 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.420006 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.421493 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.422239 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.422366 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.422556 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.422881 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.423023 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":269,"threads_started":1}
I20260811 07:32:40.423555 29743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.414508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:37125 (local address 127.0.0.1:41112)
0811 07:32:40.415002 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:40.415063 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:40.415332 (+ 269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:40.419191 (+ 3859us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:40.419194 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:40.419220 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:40.419351 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.419358 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.420744 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.420748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.421862 (+ 1114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.421873 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.423030 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.423034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.423162 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.423197 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 07:32:40.423264 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 07:32:40.423385 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":141,"threads_started":1}
I20260811 07:32:40.423682 29747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.416039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52444 (local address 127.22.4.194:42253)
0811 07:32:40.416550 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.416596 (+ 46us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.416627 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:32:40.416868 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.416876 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.417190 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.417481 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:40.418109 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.419648 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.421693 (+ 2045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.422597 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.422694 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.422911 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.423288 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.423428 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":143,"threads_started":1}
I20260811 07:32:40.424221 29745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.415483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:42253 (local address 127.0.0.1:52444)
0811 07:32:40.416513 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:40.416534 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:40.416662 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:40.417438 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:40.417446 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:40.417480 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:40.417861 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.417875 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.419839 (+ 1964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.419843 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.421497 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.421509 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.423020 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.423024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.423116 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.423138 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 07:32:40.423956 (+ 818us) client_negotiation.cc:240] Negotiation successful
0811 07:32:40.424072 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":953,"thread_start_us":168,"threads_started":1}
I20260811 07:32:40.424425 29746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.415907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:42417 (local address 127.0.0.1:41512)
0811 07:32:40.416837 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:40.416858 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:40.417192 (+ 334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:40.418136 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:40.418139 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:40.418164 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:40.418637 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.418655 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.420211 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.420215 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.421337 (+ 1122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.421348 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.422408 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.422412 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.422557 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.422622 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 07:32:40.422777 (+ 155us) client_negotiation.cc:240] Negotiation successful
0811 07:32:40.424297 (+ 1520us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":832,"thread_start_us":129,"threads_started":1}
I20260811 07:32:40.425222 29749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.417510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41112 (local address 127.22.4.193:37125)
0811 07:32:40.417945 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.417952 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.417981 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:32:40.418067 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.418081 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.418286 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.418963 (+ 677us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:40.419522 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.420597 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.422020 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.422824 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.424139 (+ 1315us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.424526 (+ 387us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.424600 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.424715 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":272,"thread_start_us":224,"threads_started":1}
I20260811 07:32:40.428751 29222 tablet_service.cc:1467] Processing CreateTablet for tablet 962c1bee6f4f4047addc10f1ea5a0e38 (DEFAULT_TABLE table=test-table [id=a2f4ad5992e14e88a252a071f0c753b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:40.428812 29617 tablet_service.cc:1467] Processing CreateTablet for tablet 962c1bee6f4f4047addc10f1ea5a0e38 (DEFAULT_TABLE table=test-table [id=a2f4ad5992e14e88a252a071f0c753b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:40.428784 29412 tablet_service.cc:1467] Processing CreateTablet for tablet 962c1bee6f4f4047addc10f1ea5a0e38 (DEFAULT_TABLE table=test-table [id=a2f4ad5992e14e88a252a071f0c753b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:40.430373 29412 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962c1bee6f4f4047addc10f1ea5a0e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:40.430385 29617 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962c1bee6f4f4047addc10f1ea5a0e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:40.430382 29222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 962c1bee6f4f4047addc10f1ea5a0e38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:40.438288 29750 tablet_bootstrap.cc:492] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7: Bootstrap starting.
I20260811 07:32:40.440397 29753 tablet_bootstrap.cc:492] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Bootstrap starting.
I20260811 07:32:40.441527 29752 tablet_bootstrap.cc:492] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Bootstrap starting.
I20260811 07:32:40.442605 29750 tablet_bootstrap.cc:654] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:40.443720 29750 log.cc:824] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:40.444255 29752 tablet_bootstrap.cc:654] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:40.445612 29752 log.cc:824] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:40.446009 29753 tablet_bootstrap.cc:654] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:40.447142 29750 tablet_bootstrap.cc:492] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7: No bootstrap required, opened a new log
I20260811 07:32:40.447458 29750 ts_tablet_manager.cc:1397] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 07:32:40.447863 29753 log.cc:824] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:40.447969 29752 tablet_bootstrap.cc:492] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: No bootstrap required, opened a new log
I20260811 07:32:40.448182 29752 ts_tablet_manager.cc:1397] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:32:40.450304 29753 tablet_bootstrap.cc:492] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: No bootstrap required, opened a new log
I20260811 07:32:40.450619 29753 ts_tablet_manager.cc:1397] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260811 07:32:40.452495 29750 raft_consensus.cc:348] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.452495 29752 raft_consensus.cc:348] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.452845 29750 raft_consensus.cc:374] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:40.452845 29752 raft_consensus.cc:374] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:40.452915 29752 raft_consensus.cc:729] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d15736d9179d4e6e841ee947babac134, State: Initialized, Role: FOLLOWER
I20260811 07:32:40.452939 29750 raft_consensus.cc:729] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6a6ef9ced5417fbc364815aec5d3e7, State: Initialized, Role: FOLLOWER
I20260811 07:32:40.453464 29752 consensus_queue.cc:260] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.453464 29750 consensus_queue.cc:260] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.454733 29750 ts_tablet_manager.cc:1428] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260811 07:32:40.454733 29752 ts_tablet_manager.cc:1428] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 07:32:40.454857 29313 heartbeater.cc:503] Master 127.22.4.254:36023 was elected leader, sending a full tablet report...
I20260811 07:32:40.454875 29753 raft_consensus.cc:348] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.455241 29753 raft_consensus.cc:374] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:40.455299 29753 raft_consensus.cc:729] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c3a728ec1b746bb9c6422848a4c09bb, State: Initialized, Role: FOLLOWER
I20260811 07:32:40.455780 29506 heartbeater.cc:503] Master 127.22.4.254:36023 was elected leader, sending a full tablet report...
I20260811 07:32:40.455878 29753 consensus_queue.cc:260] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.457183 29753 ts_tablet_manager.cc:1428] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Time spent starting tablet: real 0.006s user 0.003s sys 0.005s
I20260811 07:32:40.457633 29724 heartbeater.cc:503] Master 127.22.4.254:36023 was elected leader, sending a full tablet report...
W20260811 07:32:40.521107 29314 tablet.cc:2369] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:32:40.544142 29507 tablet.cc:2369] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:32:40.602555 29726 tablet.cc:2369] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:40.612461 29765 raft_consensus.cc:482] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:40.612748 29765 raft_consensus.cc:504] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.614130 29765 leader_election.cc:288] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d15736d9179d4e6e841ee947babac134 (127.22.4.194:42253), 2c3a728ec1b746bb9c6422848a4c09bb (127.22.4.195:42417)
I20260811 07:32:40.619107 29744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.614721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:58943 (local address 127.22.4.195:42417)
0811 07:32:40.614902 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.614907 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.615136 (+ 229us) server_negotiation.cc:407] Connection header received
0811 07:32:40.615345 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.615348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.615397 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.615513 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:40.616018 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.616592 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.617930 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.618399 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.618536 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.618604 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.618859 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.618958 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:32:40.619164 29747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.614545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:37653 (local address 127.22.4.194:42253)
0811 07:32:40.614742 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.614750 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.615096 (+ 346us) server_negotiation.cc:407] Connection header received
0811 07:32:40.615295 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.615301 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.615363 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.615437 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:40.615880 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.616480 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.617987 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.618431 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.618597 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.618672 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.618948 (+ 276us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.619041 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:32:40.619228 29767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.614403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:42253 (local address 127.22.4.193:37653)
0811 07:32:40.614967 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:40.614981 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:40.615141 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:40.615501 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:40.615505 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:40.615528 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:40.615749 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.615756 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.616637 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.616644 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.617791 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.617804 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.618620 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.618627 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.618740 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.618804 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 07:32:40.618930 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 07:32:40.619023 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"mutex_wait_us":43,"spinlock_wait_cycles":46336,"thread_start_us":206,"threads_started":1}
I20260811 07:32:40.619686 29768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.614569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:42417 (local address 127.22.4.193:58943)
0811 07:32:40.614983 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:40.615000 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:40.615172 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:40.615558 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:40.615561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:40.615601 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:40.615842 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.615851 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.616732 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.616736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.617777 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:40.617787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.618554 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.618558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:40.618663 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.618700 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:32:40.618788 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:32:40.618941 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":83,"thread_start_us":188,"threads_started":1}
I20260811 07:32:40.620267 29443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962c1bee6f4f4047addc10f1ea5a0e38" candidate_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15736d9179d4e6e841ee947babac134" is_pre_election: true
I20260811 07:32:40.620743 29443 raft_consensus.cc:2454] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6a6ef9ced5417fbc364815aec5d3e7 in term 0.
I20260811 07:32:40.620905 29652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962c1bee6f4f4047addc10f1ea5a0e38" candidate_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" is_pre_election: true
I20260811 07:32:40.621438 29652 raft_consensus.cc:2454] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af6a6ef9ced5417fbc364815aec5d3e7 in term 0.
I20260811 07:32:40.621742 29154 leader_election.cc:302] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af6a6ef9ced5417fbc364815aec5d3e7, d15736d9179d4e6e841ee947babac134; no voters:
I20260811 07:32:40.622350 29765 raft_consensus.cc:2781] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:40.622489 29765 raft_consensus.cc:482] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:40.622557 29765 raft_consensus.cc:3037] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:40.623839 29765 raft_consensus.cc:504] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.624329 29765 leader_election.cc:288] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [CANDIDATE]: Term 1 election: Requested vote from peers d15736d9179d4e6e841ee947babac134 (127.22.4.194:42253), 2c3a728ec1b746bb9c6422848a4c09bb (127.22.4.195:42417)
I20260811 07:32:40.625190 29652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962c1bee6f4f4047addc10f1ea5a0e38" candidate_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c3a728ec1b746bb9c6422848a4c09bb"
I20260811 07:32:40.625253 29443 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "962c1bee6f4f4047addc10f1ea5a0e38" candidate_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d15736d9179d4e6e841ee947babac134"
I20260811 07:32:40.625429 29652 raft_consensus.cc:3037] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:40.625429 29443 raft_consensus.cc:3037] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:40.627444 29652 raft_consensus.cc:2454] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6a6ef9ced5417fbc364815aec5d3e7 in term 1.
I20260811 07:32:40.627444 29443 raft_consensus.cc:2454] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af6a6ef9ced5417fbc364815aec5d3e7 in term 1.
I20260811 07:32:40.628129 29152 leader_election.cc:302] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2c3a728ec1b746bb9c6422848a4c09bb, af6a6ef9ced5417fbc364815aec5d3e7, d15736d9179d4e6e841ee947babac134; no voters:
I20260811 07:32:40.628484 29765 raft_consensus.cc:2781] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:40.628870 29765 raft_consensus.cc:686] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 1 LEADER]: Becoming Leader. State: Replica: af6a6ef9ced5417fbc364815aec5d3e7, State: Running, Role: LEADER
I20260811 07:32:40.629390 29765 consensus_queue.cc:237] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } }
I20260811 07:32:40.633592 29018 catalog_manager.cc:5495] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to af6a6ef9ced5417fbc364815aec5d3e7 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af6a6ef9ced5417fbc364815aec5d3e7" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 37125 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:40.670872 29749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.666239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41114 (local address 127.22.4.193:37125)
0811 07:32:40.666396 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:40.666401 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:40.666419 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:32:40.666566 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:40.666569 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:40.666698 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:40.666892 (+ 194us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:40.667278 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.667925 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.669038 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:40.669292 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:40.669393 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:40.669789 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:40.670387 (+ 598us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:40.670526 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:40.670600 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 07:32:40.670664 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:32:40.679150 29652 raft_consensus.cc:1261] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 1 FOLLOWER]: Refusing update from remote peer af6a6ef9ced5417fbc364815aec5d3e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:40.679229 29443 raft_consensus.cc:1261] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 1 FOLLOWER]: Refusing update from remote peer af6a6ef9ced5417fbc364815aec5d3e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:40.680325 29765 consensus_queue.cc:1035] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d15736d9179d4e6e841ee947babac134" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:40.680657 29772 consensus_queue.cc:1035] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c3a728ec1b746bb9c6422848a4c09bb" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 42417 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:40.692929 29778 mvcc.cc:205] Tried to move back new op lower bound from 7317231864530681856 to 7317231864341147648. Current Snapshot: MvccSnapshot[applied={T|T < 7317231864530681856}]
I20260811 07:32:40.692873 29776 mvcc.cc:205] Tried to move back new op lower bound from 7317231864530681856 to 7317231864341147648. Current Snapshot: MvccSnapshot[applied={T|T < 7317231864530681856}]
I20260811 07:32:40.703904 29018 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:40.704224 29018 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49678:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:40.708014 29018 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b81599c1d17e4dacb952a24fa5262234: Sending DeleteTablet for 3 replicas of tablet 962c1bee6f4f4047addc10f1ea5a0e38
I20260811 07:32:40.709180 29617 tablet_service.cc:1514] Processing DeleteTablet for tablet 962c1bee6f4f4047addc10f1ea5a0e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:40 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:41512
I20260811 07:32:40.709405 29412 tablet_service.cc:1514] Processing DeleteTablet for tablet 962c1bee6f4f4047addc10f1ea5a0e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:40 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:52444
I20260811 07:32:40.709493 29222 tablet_service.cc:1514] Processing DeleteTablet for tablet 962c1bee6f4f4047addc10f1ea5a0e38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:40 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:41112
I20260811 07:32:40.709980 29794 tablet_replica.cc:330] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: stopping tablet replica
I20260811 07:32:40.710016 29796 tablet_replica.cc:330] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7: stopping tablet replica
I20260811 07:32:40.710443 29796 raft_consensus.cc:2229] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:40.710460 29794 raft_consensus.cc:2229] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:40.710772 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 29128
I20260811 07:32:40.710978 29796 raft_consensus.cc:2258] T 962c1bee6f4f4047addc10f1ea5a0e38 P af6a6ef9ced5417fbc364815aec5d3e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:40.711094 29794 raft_consensus.cc:2258] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:40.723805 29794 ts_tablet_manager.cc:1905] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:40.727824 29797 tablet_replica.cc:330] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: stopping tablet replica
I20260811 07:32:40.728559 29797 raft_consensus.cc:2229] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:40.728662 29794 ts_tablet_manager.cc:1918] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:40.728847 29794 log.cc:1196] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/962c1bee6f4f4047addc10f1ea5a0e38
I20260811 07:32:40.729286 29794 ts_tablet_manager.cc:1939] T 962c1bee6f4f4047addc10f1ea5a0e38 P 2c3a728ec1b746bb9c6422848a4c09bb: Deleting consensus metadata
I20260811 07:32:40.729307 29797 raft_consensus.cc:2258] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:40.731431 29002 catalog_manager.cc:4841] TS 2c3a728ec1b746bb9c6422848a4c09bb (127.22.4.195:42417): tablet 962c1bee6f4f4047addc10f1ea5a0e38 (table test-table [id=a2f4ad5992e14e88a252a071f0c753b4]) successfully deleted
I20260811 07:32:40.731694 29797 ts_tablet_manager.cc:1905] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:40.734184 29797 ts_tablet_manager.cc:1918] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:40.734315 29797 log.cc:1196] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/962c1bee6f4f4047addc10f1ea5a0e38
I20260811 07:32:40.734633 29797 ts_tablet_manager.cc:1939] T 962c1bee6f4f4047addc10f1ea5a0e38 P d15736d9179d4e6e841ee947babac134: Deleting consensus metadata
I20260811 07:32:40.736315 29004 catalog_manager.cc:4841] TS d15736d9179d4e6e841ee947babac134 (127.22.4.194:42253): tablet 962c1bee6f4f4047addc10f1ea5a0e38 (table test-table [id=a2f4ad5992e14e88a252a071f0c753b4]) successfully deleted
W20260811 07:32:40.737597 29004 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:37125 (error 108)
I20260811 07:32:40.737910 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 29320
I20260811 07:32:40.747570 29746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:40.747020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:37125 (local address 127.0.0.1:41120)
0811 07:32:40.747320 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:40.747430 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182}
W20260811 07:32:40.749328 29004 catalog_manager.cc:4584] TS af6a6ef9ced5417fbc364815aec5d3e7 (127.22.4.193:37125): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 962c1bee6f4f4047addc10f1ea5a0e38: Network error: Client connection negotiation failed: client connection to 127.22.4.193:37125: connect: Connection refused (error 111)
I20260811 07:32:40.758818 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 29513
I20260811 07:32:40.787531 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 28978
2026-08-11T07:32:40Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (3167 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T07:32:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:40Z Disabled control of system clock
I20260811 07:32:40.849853 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38481
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:38481
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:32:41.028672 29803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:41.029165 29803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:41.029218 29803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:41.037092 29803 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:41.037279 29803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:41.037309 29803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:41.037333 29803 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:41.037352 29803 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:41.045372 29803 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:38481
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38481
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:41.047623 29803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:41.050135 29803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:41.064554 29815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:41.064538 29813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:41.064538 29817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:41.065244 29803 server_base.cc:1034] running on GCE node
I20260811 07:32:41.066190 29803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:41.067742 29803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:41.071179 29803 hybrid_clock.cc:648] HybridClock initialized: now 1786433561071105 us; error 93 us; skew 500 ppm
I20260811 07:32:41.078928 29803 webserver.cc:460] Webserver started at http://127.22.4.254:45741/ using document root <none> and password file <none>
I20260811 07:32:41.079823 29803 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:41.079962 29803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:41.080259 29803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:41.082975 29803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "47287bf9b6694072ba2803431b3899ee"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "5b072feea902c5d2e02ba52397bb60a2"
server_key_iv: "0161bd4e6cf5b750dbae53151e6dd777"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.083741 29803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "47287bf9b6694072ba2803431b3899ee"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "5b072feea902c5d2e02ba52397bb60a2"
server_key_iv: "0161bd4e6cf5b750dbae53151e6dd777"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.088925 29803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:32:41.092954 29830 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.094954 29803 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:32:41.095206 29803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "47287bf9b6694072ba2803431b3899ee"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "5b072feea902c5d2e02ba52397bb60a2"
server_key_iv: "0161bd4e6cf5b750dbae53151e6dd777"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.095389 29803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:41.101533 29803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:41.102406 29803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:41.102676 29803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:41.112646 29803 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:38481
I20260811 07:32:41.112716 29904 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:38481 every 8 connection(s)
I20260811 07:32:41.113931 29803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:41.115471 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 29803
I20260811 07:32:41.115643 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:41.116067 22547 external_mini_cluster.cc:1428] Setting key 712d05c48328eff8ca018f09bd914a88
I20260811 07:32:41.119462 29905 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:41.126977 29911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:41.118214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55898 (local address 127.22.4.254:38481)
0811 07:32:41.120231 (+ 2017us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:41.120254 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:41.120308 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:32:41.121858 (+ 1550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:41.121906 (+ 48us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:41.122706 (+ 800us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:41.123301 (+ 595us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:41.124711 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:41.124717 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:41.124734 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:41.124747 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:41.124821 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:41.124846 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:41.125068 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:41.125157 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 07:32:41.125632 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1374,"thread_start_us":1046,"threads_started":1}
I20260811 07:32:41.130923 29905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee: Bootstrap starting.
I20260811 07:32:41.134479 29905 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:41.136015 29905 log.cc:824] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:41.139423 29905 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee: No bootstrap required, opened a new log
I20260811 07:32:41.144517 29905 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47287bf9b6694072ba2803431b3899ee" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38481 } }
I20260811 07:32:41.144913 29905 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:41.144958 29905 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47287bf9b6694072ba2803431b3899ee, State: Initialized, Role: FOLLOWER
I20260811 07:32:41.145519 29905 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47287bf9b6694072ba2803431b3899ee" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38481 } }
I20260811 07:32:41.145670 29905 raft_consensus.cc:388] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:41.145767 29905 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:41.145884 29905 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:41.147229 29905 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47287bf9b6694072ba2803431b3899ee" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38481 } }
I20260811 07:32:41.147675 29905 leader_election.cc:302] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 47287bf9b6694072ba2803431b3899ee; no voters:
I20260811 07:32:41.148108 29905 leader_election.cc:288] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:41.148492 29913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:41.148836 29913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [term 1 LEADER]: Becoming Leader. State: Replica: 47287bf9b6694072ba2803431b3899ee, State: Running, Role: LEADER
I20260811 07:32:41.149328 29913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47287bf9b6694072ba2803431b3899ee" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38481 } }
I20260811 07:32:41.149811 29905 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:41.151695 29915 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47287bf9b6694072ba2803431b3899ee. Latest consensus state: current_term: 1 leader_uuid: "47287bf9b6694072ba2803431b3899ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47287bf9b6694072ba2803431b3899ee" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38481 } } }
I20260811 07:32:41.151894 29915 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:41.152221 29914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "47287bf9b6694072ba2803431b3899ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "47287bf9b6694072ba2803431b3899ee" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38481 } } }
I20260811 07:32:41.152335 29914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee [sys.catalog]: This master's current role is: LEADER
W20260811 07:32:41.156471 29937 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:41.156615 29937 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:41.156690 29938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:41.157517 29938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:41.164103 29938 catalog_manager.cc:1347] Generated new cluster ID: 8cb3610479f44b8bacd484184b996520
I20260811 07:32:41.164209 29938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:41.200342 29938 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:41.200969 29938 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:41.215083 29938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee: Generated new TSK 0
I20260811 07:32:41.216173 29938 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:32:41.234364 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38481
--builtin_ntp_servers=127.22.4.212:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 07:32:41.409070 29945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:41.409422 29945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:41.409466 29945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:41.413800 29945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:41.413884 29945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:41.413946 29945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:41.419209 29945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:41.420617 29945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:41.422533 29945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:41.435387 29952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:41.435603 29955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:41.435446 29945 server_base.cc:1034] running on GCE node
W20260811 07:32:41.435446 29950 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:41.436414 29945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:41.437306 29945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:41.438652 29945 hybrid_clock.cc:648] HybridClock initialized: now 1786433561438621 us; error 52 us; skew 500 ppm
I20260811 07:32:41.441090 29945 webserver.cc:460] Webserver started at http://127.22.4.193:39795/ using document root <none> and password file <none>
I20260811 07:32:41.441823 29945 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:41.441938 29945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:41.442212 29945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:41.444757 29945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "ae5449dd51aeb9dda519206646b26049"
server_key_iv: "614b4678b8935d74d96d9a919bf20a54"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.445447 29945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "ae5449dd51aeb9dda519206646b26049"
server_key_iv: "614b4678b8935d74d96d9a919bf20a54"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.450500 29945 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:41.454365 29964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.456422 29945 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260811 07:32:41.456725 29945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "ae5449dd51aeb9dda519206646b26049"
server_key_iv: "614b4678b8935d74d96d9a919bf20a54"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.456884 29945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:41.462236 29945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:41.462998 29945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:41.463203 29945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:41.463841 29945 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:41.464907 29945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:41.464986 29945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.465059 29945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:41.465106 29945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.476964 29945 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:40059
I20260811 07:32:41.477017 30128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:40059 every 8 connection(s)
I20260811 07:32:41.478135 29945 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:41.480309 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 29945
I20260811 07:32:41.480525 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:41.480937 22547 external_mini_cluster.cc:1428] Setting key 847e63f77b8493f78f330a4c6c984a63
I20260811 07:32:41.483947 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38481
--builtin_ntp_servers=127.22.4.212:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 07:32:41.486730 29911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:41.481283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:51447 (local address 127.22.4.254:38481)
0811 07:32:41.481571 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:41.481577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:41.483110 (+ 1533us) server_negotiation.cc:407] Connection header received
0811 07:32:41.484721 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:41.484725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:41.484779 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:41.484881 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:41.486184 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:41.486188 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:41.486191 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:41.486205 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:41.486227 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:41.486243 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:41.486348 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:41.486520 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 07:32:41.486575 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:32:41.487754 30131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:41.481851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38481 (local address 127.22.4.193:51447)
0811 07:32:41.482889 (+ 1038us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:41.482955 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:41.484447 (+ 1492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:41.485095 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:41.485103 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:41.485204 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:41.485885 (+ 681us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:32:41.485886 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:41.485932 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:32:41.486011 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:41.486347 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:41.486358 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:41.486368 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:32:41.486574 (+ 206us) client_negotiation.cc:240] Negotiation successful
0811 07:32:41.486886 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":157,"threads_started":1}
I20260811 07:32:41.489552 30129 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38481
I20260811 07:32:41.489890 30129 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:41.490417 30129 heartbeater.cc:511] Master 127.22.4.254:38481 requested a full tablet report, sending...
I20260811 07:32:41.492431 29851 ts_manager.cc:194] Registered new tserver with Master: 4502ac7ecb6d47d1a5e6b353c6e2b5ab (127.22.4.193:40059)
W20260811 07:32:41.641014 30132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:41.641501 30132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:41.641590 30132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:41.647004 30132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:41.647114 30132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:41.647224 30132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:41.654063 30132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:41.655944 30132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:41.657972 30132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:41.671787 30147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:41.671984 30143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:41.671777 30142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:41.672493 30132 server_base.cc:1034] running on GCE node
I20260811 07:32:41.673117 30132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:41.674053 30132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:41.675426 30132 hybrid_clock.cc:648] HybridClock initialized: now 1786433561675383 us; error 56 us; skew 500 ppm
I20260811 07:32:41.678004 30132 webserver.cc:460] Webserver started at http://127.22.4.194:44929/ using document root <none> and password file <none>
I20260811 07:32:41.678972 30132 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:41.679091 30132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:41.679401 30132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:41.682152 30132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "0fdb7bf8e19742f8ae649ce60e358f70"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "d64d1bf1de9daf4fdaafa5bce0d8dac9"
server_key_iv: "cb68783e7d2aea82433980171440c43a"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.682999 30132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "0fdb7bf8e19742f8ae649ce60e358f70"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "d64d1bf1de9daf4fdaafa5bce0d8dac9"
server_key_iv: "cb68783e7d2aea82433980171440c43a"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.688239 30132 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:32:41.692551 30154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.694614 30132 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:32:41.694929 30132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "0fdb7bf8e19742f8ae649ce60e358f70"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "d64d1bf1de9daf4fdaafa5bce0d8dac9"
server_key_iv: "cb68783e7d2aea82433980171440c43a"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.695122 30132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:41.701370 30132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:41.702309 30132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:41.702558 30132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:41.703423 30132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:41.704730 30132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:41.704813 30132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.704895 30132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:41.704941 30132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.719408 30132 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:34949
I20260811 07:32:41.719480 30320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:34949 every 8 connection(s)
I20260811 07:32:41.720814 30132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:41.727291 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 30132
I20260811 07:32:41.727473 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:41.727828 22547 external_mini_cluster.cc:1428] Setting key fc6731dbf4b78565f0858f96caf2f0e3
I20260811 07:32:41.730487 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38481
--builtin_ntp_servers=127.22.4.212:39235
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260811 07:32:41.730916 29911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:41.723665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:33207 (local address 127.22.4.254:38481)
0811 07:32:41.723820 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:41.723824 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:41.725913 (+ 2089us) server_negotiation.cc:407] Connection header received
0811 07:32:41.728073 (+ 2160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:41.728079 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:41.728161 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:41.728289 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:41.730137 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:41.730149 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:41.730152 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:41.730168 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:41.730196 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:41.730206 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:41.730346 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:41.730541 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 07:32:41.730691 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:32:41.732318 30323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:41.724348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38481 (local address 127.22.4.194:33207)
0811 07:32:41.725673 (+ 1325us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:41.725731 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:41.727601 (+ 1870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:41.728810 (+ 1209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:41.728820 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:41.728943 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:41.729699 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:32:41.729701 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:41.729774 (+ 73us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:32:41.729902 (+ 128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:41.730326 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:41.730338 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:41.730346 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:32:41.730632 (+ 286us) client_negotiation.cc:240] Negotiation successful
0811 07:32:41.731085 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":206,"threads_started":1}
I20260811 07:32:41.733968 30321 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38481
I20260811 07:32:41.734371 30321 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:41.735029 30321 heartbeater.cc:511] Master 127.22.4.254:38481 requested a full tablet report, sending...
I20260811 07:32:41.736562 29851 ts_manager.cc:194] Registered new tserver with Master: 0fdb7bf8e19742f8ae649ce60e358f70 (127.22.4.194:34949)
W20260811 07:32:41.881647 30325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:41.882119 30325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:41.882207 30325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:41.886962 30325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:41.887079 30325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:41.887188 30325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:41.892800 30325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39235
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38481
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:41.894511 30325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:41.896603 30325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:41.910809 30335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:41.910990 30340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:41.911041 30325 server_base.cc:1034] running on GCE node
W20260811 07:32:41.910907 30336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:41.912282 30325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:41.913354 30325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:41.914636 30325 hybrid_clock.cc:648] HybridClock initialized: now 1786433561914586 us; error 72 us; skew 500 ppm
I20260811 07:32:41.922946 30325 webserver.cc:460] Webserver started at http://127.22.4.195:44575/ using document root <none> and password file <none>
I20260811 07:32:41.923959 30325 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:41.924129 30325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:41.924492 30325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:41.927846 30325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "5475afcacf3e177169b49f5e4d9745f1"
server_key_iv: "239599de7ba8bf75a862a666aa69a890"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.928661 30325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "5475afcacf3e177169b49f5e4d9745f1"
server_key_iv: "239599de7ba8bf75a862a666aa69a890"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.934446 30325 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:41.938485 30348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.940496 30325 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:41.940781 30325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc"
format_stamp: "Formatted at 2026-08-11 07:32:41 on dist-test-slave-7z32"
server_key: "5475afcacf3e177169b49f5e4d9745f1"
server_key_iv: "239599de7ba8bf75a862a666aa69a890"
server_key_version: "encryptionkey@0"
I20260811 07:32:41.940976 30325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:41.947863 30325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:41.949023 30325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:41.949302 30325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:41.950232 30325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:41.951885 30325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:41.951973 30325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.952050 30325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:41.952103 30325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:41.966377 30325 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:39785
I20260811 07:32:41.966513 30520 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:39785 every 8 connection(s)
I20260811 07:32:41.967830 30325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:41.972512 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 30325
I20260811 07:32:41.972683 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:41.973073 22547 external_mini_cluster.cc:1428] Setting key 7e5f85e0e5143d5b439eb57467bd6fdb
I20260811 07:32:41.977442 29911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:41.970664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:60541 (local address 127.22.4.254:38481)
0811 07:32:41.970975 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:41.970981 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:41.973186 (+ 2205us) server_negotiation.cc:407] Connection header received
0811 07:32:41.975074 (+ 1888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:41.975077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:41.975163 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:41.975287 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:41.976772 (+ 1485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:41.976775 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:41.976778 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:41.976793 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:41.976824 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:41.976834 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:41.976964 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:41.977221 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 07:32:41.977280 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 07:32:41.978698 30525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:41.971357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38481 (local address 127.22.4.195:60541)
0811 07:32:41.972750 (+ 1393us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:41.972833 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:41.974723 (+ 1890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:41.975497 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:41.975505 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:41.975624 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:41.976413 (+ 789us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:32:41.976414 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:41.976466 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:32:41.976552 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:41.977003 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:41.977015 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:41.977021 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:32:41.977251 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 07:32:41.977554 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":174,"threads_started":1}
I20260811 07:32:41.980710 30521 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38481
I20260811 07:32:41.981179 30521 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:41.981805 30521 heartbeater.cc:511] Master 127.22.4.254:38481 requested a full tablet report, sending...
I20260811 07:32:41.983677 29851 ts_manager.cc:194] Registered new tserver with Master: 0ffc1f862a6b4599a3e8134bfb8f69cc (127.22.4.195:39785)
I20260811 07:32:41.988962 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:32:41.994071 29911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:41.992014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55910 (local address 127.22.4.254:38481)
0811 07:32:41.992183 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:41.992187 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:41.992308 (+ 121us) server_negotiation.cc:407] Connection header received
0811 07:32:41.992452 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:41.992454 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:41.992519 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:41.992634 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:41.993568 (+ 934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:41.993572 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:41.993574 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:41.993585 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:41.993608 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:41.993618 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:41.993707 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:41.993882 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 07:32:41.993926 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:32:41.998517 29851 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55910:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:42.003212 29851 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:42.021499 30538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.016828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44190 (local address 127.22.4.194:34949)
0811 07:32:42.017631 (+ 803us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:42.017660 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:42.018349 (+ 689us) server_negotiation.cc:407] Connection header received
0811 07:32:42.018620 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:42.018628 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:42.018894 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:42.019080 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:42.020556 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:42.020565 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:42.020583 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:42.020607 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:42.020664 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:42.020698 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:42.020871 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:42.021212 (+ 341us) server_negotiation.cc:299] Negotiation successful
0811 07:32:42.021312 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":223,"threads_started":1}
I20260811 07:32:42.021773 30537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.017219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:40059 (local address 127.0.0.1:37238)
0811 07:32:42.018120 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:42.018210 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:42.018385 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:42.019638 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:42.019641 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:42.019660 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:42.020780 (+ 1120us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:32:42.020785 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:42.020801 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:32:42.020840 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:42.021349 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:42.021352 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:42.021356 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:32:42.021431 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 07:32:42.021532 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":657,"mutex_wait_us":54,"spinlock_wait_cycles":41088,"thread_start_us":148,"threads_started":1}
I20260811 07:32:42.021477 30543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.016464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:34949 (local address 127.0.0.1:44190)
0811 07:32:42.018120 (+ 1656us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:42.018210 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:42.018405 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:42.019116 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:42.019123 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:42.019246 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:42.020169 (+ 923us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:32:42.020171 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:42.020198 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:32:42.020319 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:42.020989 (+ 670us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:42.021005 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:42.021017 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 07:32:42.021175 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 07:32:42.021281 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1379,"thread_start_us":107,"threads_started":1}
I20260811 07:32:42.021916 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.017879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37238 (local address 127.22.4.193:40059)
0811 07:32:42.018510 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:42.018519 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:42.018551 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:32:42.018609 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:42.018616 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:42.018894 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:42.019080 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:42.021035 (+ 1955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:42.021045 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:42.021060 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:42.021078 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:42.021122 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:42.021181 (+ 59us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:42.021303 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:42.021521 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 07:32:42.021610 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":107,"threads_started":1}
I20260811 07:32:42.023082 30542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.017356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:39785 (local address 127.0.0.1:35546)
0811 07:32:42.018572 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:42.018586 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:42.018712 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:42.020179 (+ 1467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:42.020182 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:42.020198 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:42.020960 (+ 762us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:32:42.020962 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:42.020972 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:32:42.020995 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:42.021349 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:42.021352 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:42.021356 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:32:42.021422 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 07:32:42.021484 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1137,"thread_start_us":153,"threads_started":1}
I20260811 07:32:42.023577 30546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.017977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35546 (local address 127.22.4.195:39785)
0811 07:32:42.018423 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:42.018439 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:42.018725 (+ 286us) server_negotiation.cc:407] Connection header received
0811 07:32:42.018870 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:42.018877 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:42.019153 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:42.019314 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:42.021139 (+ 1825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:42.021145 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:42.021154 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:42.021167 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:42.021212 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:42.021245 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:42.023204 (+ 1959us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:42.023279 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 07:32:42.023391 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315,"thread_start_us":197,"threads_started":1}
I20260811 07:32:42.025815 30038 tablet_service.cc:1467] Processing CreateTablet for tablet 4ccead289361425ea48f51b630527860 (DEFAULT_TABLE table=test-table [id=e5a50c266e9142118b5c91ed75bdf471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:42.025882 30225 tablet_service.cc:1467] Processing CreateTablet for tablet 4ccead289361425ea48f51b630527860 (DEFAULT_TABLE table=test-table [id=e5a50c266e9142118b5c91ed75bdf471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:42.027282 30038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ccead289361425ea48f51b630527860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:42.027333 30225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ccead289361425ea48f51b630527860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:42.026868 30424 tablet_service.cc:1467] Processing CreateTablet for tablet 4ccead289361425ea48f51b630527860 (DEFAULT_TABLE table=test-table [id=e5a50c266e9142118b5c91ed75bdf471]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:42.027972 30424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ccead289361425ea48f51b630527860. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:42.035825 30547 tablet_bootstrap.cc:492] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab: Bootstrap starting.
I20260811 07:32:42.037618 30550 tablet_bootstrap.cc:492] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Bootstrap starting.
I20260811 07:32:42.038169 30551 tablet_bootstrap.cc:492] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Bootstrap starting.
I20260811 07:32:42.038692 30547 tablet_bootstrap.cc:654] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:42.039750 30547 log.cc:824] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:42.040694 30551 tablet_bootstrap.cc:654] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:42.041158 30550 tablet_bootstrap.cc:654] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:42.041697 30551 log.cc:824] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:42.042158 30550 log.cc:824] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:42.042603 30547 tablet_bootstrap.cc:492] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab: No bootstrap required, opened a new log
I20260811 07:32:42.042887 30547 ts_tablet_manager.cc:1397] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 07:32:42.044154 30551 tablet_bootstrap.cc:492] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: No bootstrap required, opened a new log
I20260811 07:32:42.044370 30551 ts_tablet_manager.cc:1397] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260811 07:32:42.044600 30550 tablet_bootstrap.cc:492] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: No bootstrap required, opened a new log
I20260811 07:32:42.044843 30550 ts_tablet_manager.cc:1397] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:32:42.047979 30547 raft_consensus.cc:348] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.048527 30547 raft_consensus.cc:374] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:42.048648 30547 raft_consensus.cc:729] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4502ac7ecb6d47d1a5e6b353c6e2b5ab, State: Initialized, Role: FOLLOWER
I20260811 07:32:42.049265 30547 consensus_queue.cc:260] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.049291 30551 raft_consensus.cc:348] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.049592 30551 raft_consensus.cc:374] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:42.049717 30551 raft_consensus.cc:729] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ffc1f862a6b4599a3e8134bfb8f69cc, State: Initialized, Role: FOLLOWER
I20260811 07:32:42.049669 30550 raft_consensus.cc:348] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.050113 30550 raft_consensus.cc:374] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:42.050223 30550 raft_consensus.cc:729] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fdb7bf8e19742f8ae649ce60e358f70, State: Initialized, Role: FOLLOWER
I20260811 07:32:42.050222 30551 consensus_queue.cc:260] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.050582 30547 ts_tablet_manager.cc:1428] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 07:32:42.050791 30550 consensus_queue.cc:260] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.051227 30129 heartbeater.cc:503] Master 127.22.4.254:38481 was elected leader, sending a full tablet report...
I20260811 07:32:42.051301 30551 ts_tablet_manager.cc:1428] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:32:42.051687 30521 heartbeater.cc:503] Master 127.22.4.254:38481 was elected leader, sending a full tablet report...
I20260811 07:32:42.052347 30550 ts_tablet_manager.cc:1428] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260811 07:32:42.052832 30321 heartbeater.cc:503] Master 127.22.4.254:38481 was elected leader, sending a full tablet report...
W20260811 07:32:42.219245 30524 tablet.cc:2369] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:32:42.222440 30322 tablet.cc:2369] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:32:42.230234 30130 tablet.cc:2369] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:42.443032 30562 raft_consensus.cc:482] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:42.443296 30562 raft_consensus.cc:504] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.444572 30562 leader_election.cc:288] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0fdb7bf8e19742f8ae649ce60e358f70 (127.22.4.194:34949), 4502ac7ecb6d47d1a5e6b353c6e2b5ab (127.22.4.193:40059)
I20260811 07:32:42.447377 30525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.445043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:34949 (local address 127.22.4.195:51333)
0811 07:32:42.445250 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:42.445271 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:42.445407 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:42.445843 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:42.445853 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:42.445874 (+ 21us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:42.446647 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:32:42.446649 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:42.446662 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:32:42.446707 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:42.447066 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:42.447070 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:42.447074 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 07:32:42.447189 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:32:42.447234 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 07:32:42.447438 30538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.445199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:51333 (local address 127.22.4.194:34949)
0811 07:32:42.445425 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:42.445452 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:42.445480 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:32:42.445544 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:42.445553 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:42.445596 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:42.445740 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:42.446892 (+ 1152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:42.446896 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:42.446900 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:42.446916 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:42.446939 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:42.446949 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:42.447069 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:42.447183 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 07:32:42.447234 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:32:42.448017 30567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.445043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:40059 (local address 127.22.4.195:50075)
0811 07:32:42.445945 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:42.445959 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:42.446057 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:42.446441 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:42.446445 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:42.446464 (+ 19us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:42.447176 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:32:42.447177 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:42.447190 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:32:42.447222 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:42.447650 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:42.447654 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:42.447657 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 07:32:42.447780 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 07:32:42.447826 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":818,"mutex_wait_us":443,"thread_start_us":98,"threads_started":1}
I20260811 07:32:42.448066 30545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.445220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:50075 (local address 127.22.4.193:40059)
0811 07:32:42.445413 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:42.445419 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:42.446078 (+ 659us) server_negotiation.cc:407] Connection header received
0811 07:32:42.446196 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:42.446199 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:42.446240 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:42.446315 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:42.447385 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:42.447389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:42.447392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:42.447418 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:42.447465 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:42.447480 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:42.447598 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:42.447815 (+ 217us) server_negotiation.cc:299] Negotiation successful
0811 07:32:42.447883 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:32:42.448388 30254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccead289361425ea48f51b630527860" candidate_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" is_pre_election: true
I20260811 07:32:42.448804 30254 raft_consensus.cc:2454] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ffc1f862a6b4599a3e8134bfb8f69cc in term 0.
I20260811 07:32:42.449389 30063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccead289361425ea48f51b630527860" candidate_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" is_pre_election: true
I20260811 07:32:42.449534 30351 leader_election.cc:302] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0fdb7bf8e19742f8ae649ce60e358f70, 0ffc1f862a6b4599a3e8134bfb8f69cc; no voters:
I20260811 07:32:42.449867 30063 raft_consensus.cc:2454] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ffc1f862a6b4599a3e8134bfb8f69cc in term 0.
I20260811 07:32:42.450057 30562 raft_consensus.cc:2781] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:42.450177 30562 raft_consensus.cc:482] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:42.450248 30562 raft_consensus.cc:3037] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:42.451954 30562 raft_consensus.cc:504] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.452486 30562 leader_election.cc:288] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [CANDIDATE]: Term 1 election: Requested vote from peers 0fdb7bf8e19742f8ae649ce60e358f70 (127.22.4.194:34949), 4502ac7ecb6d47d1a5e6b353c6e2b5ab (127.22.4.193:40059)
I20260811 07:32:42.453166 30254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccead289361425ea48f51b630527860" candidate_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0fdb7bf8e19742f8ae649ce60e358f70"
I20260811 07:32:42.453217 30063 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ccead289361425ea48f51b630527860" candidate_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab"
I20260811 07:32:42.453316 30254 raft_consensus.cc:3037] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:42.453478 30063 raft_consensus.cc:3037] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:42.454924 30254 raft_consensus.cc:2454] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ffc1f862a6b4599a3e8134bfb8f69cc in term 1.
I20260811 07:32:42.455242 30063 raft_consensus.cc:2454] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ffc1f862a6b4599a3e8134bfb8f69cc in term 1.
I20260811 07:32:42.455674 30351 leader_election.cc:302] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0fdb7bf8e19742f8ae649ce60e358f70, 0ffc1f862a6b4599a3e8134bfb8f69cc, 4502ac7ecb6d47d1a5e6b353c6e2b5ab; no voters:
I20260811 07:32:42.455987 30562 raft_consensus.cc:2781] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:42.456310 30562 raft_consensus.cc:686] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 1 LEADER]: Becoming Leader. State: Replica: 0ffc1f862a6b4599a3e8134bfb8f69cc, State: Running, Role: LEADER
I20260811 07:32:42.456792 30562 consensus_queue.cc:237] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } }
I20260811 07:32:42.461097 29849 catalog_manager.cc:5495] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ffc1f862a6b4599a3e8134bfb8f69cc (127.22.4.195). New cstate: current_term: 1 leader_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ffc1f862a6b4599a3e8134bfb8f69cc" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 39785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:42.486549 30546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.484610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35556 (local address 127.22.4.195:39785)
0811 07:32:42.484832 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:42.484836 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:42.484851 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:32:42.484957 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:42.484960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:42.485035 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:42.485117 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:42.486026 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:42.486030 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:42.486032 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:42.486043 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:42.486066 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:42.486075 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:42.486160 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:42.486293 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 07:32:42.486337 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260811 07:32:42.494612 30254 raft_consensus.cc:1261] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 1 FOLLOWER]: Refusing update from remote peer 0ffc1f862a6b4599a3e8134bfb8f69cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:42.494972 30063 raft_consensus.cc:1261] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [term 1 FOLLOWER]: Refusing update from remote peer 0ffc1f862a6b4599a3e8134bfb8f69cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:42.495648 30568 consensus_queue.cc:1035] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "0fdb7bf8e19742f8ae649ce60e358f70" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:42.495878 30562 consensus_queue.cc:1035] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4502ac7ecb6d47d1a5e6b353c6e2b5ab" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 40059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:42.505534 30571 mvcc.cc:205] Tried to move back new op lower bound from 7317231871968612352 to 7317231871825952768. Current Snapshot: MvccSnapshot[applied={T|T < 7317231871968612352}]
I20260811 07:32:42.508132 30572 mvcc.cc:205] Tried to move back new op lower bound from 7317231871968612352 to 7317231871825952768. Current Snapshot: MvccSnapshot[applied={T|T < 7317231871968612352}]
I20260811 07:32:42.510869 30574 mvcc.cc:205] Tried to move back new op lower bound from 7317231871968612352 to 7317231871825952768. Current Snapshot: MvccSnapshot[applied={T|T < 7317231871968612352}]
I20260811 07:32:42.517649 29851 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:42.517902 29851 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55910:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:42.521186 29851 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 47287bf9b6694072ba2803431b3899ee: Sending DeleteTablet for 3 replicas of tablet 4ccead289361425ea48f51b630527860
I20260811 07:32:42.522449 30424 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccead289361425ea48f51b630527860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:42 UTC) from {username='slave'} at 127.0.0.1:35546
I20260811 07:32:42.522445 30225 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccead289361425ea48f51b630527860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:42 UTC) from {username='slave'} at 127.0.0.1:44190
I20260811 07:32:42.522442 30038 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ccead289361425ea48f51b630527860 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:42 UTC) from {username='slave'} at 127.0.0.1:37238
I20260811 07:32:42.523229 30585 tablet_replica.cc:330] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: stopping tablet replica
I20260811 07:32:42.523814 30585 raft_consensus.cc:2229] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:42.524240 30587 tablet_replica.cc:330] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab: stopping tablet replica
I20260811 07:32:42.524365 30585 raft_consensus.cc:2258] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:42.524413 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 29945
I20260811 07:32:42.524672 30587 raft_consensus.cc:2229] T 4ccead289361425ea48f51b630527860 P 4502ac7ecb6d47d1a5e6b353c6e2b5ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:42.524997 30584 tablet_replica.cc:330] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: stopping tablet replica
I20260811 07:32:42.525364 30584 raft_consensus.cc:2229] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:42.525781 30584 raft_consensus.cc:2258] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:42.527185 30585 ts_tablet_manager.cc:1905] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:42.538232 30584 ts_tablet_manager.cc:1905] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:42.541981 30584 ts_tablet_manager.cc:1918] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:42.533334 30585 ts_tablet_manager.cc:1918] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:42.542433 30585 log.cc:1196] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/4ccead289361425ea48f51b630527860
I20260811 07:32:42.542896 30585 ts_tablet_manager.cc:1939] T 4ccead289361425ea48f51b630527860 P 0ffc1f862a6b4599a3e8134bfb8f69cc: Deleting consensus metadata
I20260811 07:32:42.542156 30584 log.cc:1196] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/4ccead289361425ea48f51b630527860
I20260811 07:32:42.544639 30584 ts_tablet_manager.cc:1939] T 4ccead289361425ea48f51b630527860 P 0fdb7bf8e19742f8ae649ce60e358f70: Deleting consensus metadata
I20260811 07:32:42.544646 29832 catalog_manager.cc:4841] TS 0ffc1f862a6b4599a3e8134bfb8f69cc (127.22.4.195:39785): tablet 4ccead289361425ea48f51b630527860 (table test-table [id=e5a50c266e9142118b5c91ed75bdf471]) successfully deleted
W20260811 07:32:42.546231 29834 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:40059 (error 108)
I20260811 07:32:42.547040 29832 catalog_manager.cc:4841] TS 0fdb7bf8e19742f8ae649ce60e358f70 (127.22.4.194:34949): tablet 4ccead289361425ea48f51b630527860 (table test-table [id=e5a50c266e9142118b5c91ed75bdf471]) successfully deleted
I20260811 07:32:42.547580 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 30132
I20260811 07:32:42.550714 30589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.547484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:40059 (local address 127.0.0.1:37244)
0811 07:32:42.550463 (+ 2979us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:42.550582 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:40059: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":76,"threads_started":1}
W20260811 07:32:42.563778 29834 catalog_manager.cc:4584] TS 4502ac7ecb6d47d1a5e6b353c6e2b5ab (127.22.4.193:40059): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4ccead289361425ea48f51b630527860: Network error: Client connection negotiation failed: client connection to 127.22.4.193:40059: connect: Connection refused (error 111)
I20260811 07:32:42.572422 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 30325
I20260811 07:32:42.594267 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 29803
2026-08-11T07:32:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1797 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 07:32:42.632316 22547 mini_oidc.cc:152] Starting JWKS server
I20260811 07:32:42.634621 22547 webserver.cc:460] Webserver started at https://127.0.0.1:35425/ using document root <none> and password file <none>
I20260811 07:32:42.634914 22547 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:32:42.635288 22547 webserver.cc:460] Webserver started at http://127.0.0.1:44963/ using document root <none> and password file <none>
2026-08-11T07:32:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:42Z Disabled control of system clock
I20260811 07:32:42.651795 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34981
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:44153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34981
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35425/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/testchainca.cert with env {}
W20260811 07:32:42.798527 30598 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:42.799031 30598 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:42.799089 30598 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:42.803634 30598 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:42.803738 30598 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:42.803756 30598 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:42.803777 30598 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:42.803793 30598 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:32:42.803813 30598 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:32:42.803826 30598 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:35425/jwks.json
I20260811 07:32:42.811332 30598 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34981
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:35425/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30598
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:42.812981 30598 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:42.814391 30598 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:42.826399 30606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:42.826363 30609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:42.826354 30598 server_base.cc:1034] running on GCE node
W20260811 07:32:42.826319 30607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:42.827641 30598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:42.829221 30598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:42.830472 30598 hybrid_clock.cc:648] HybridClock initialized: now 1786433562830427 us; error 68 us; skew 500 ppm
I20260811 07:32:42.833312 30598 webserver.cc:460] Webserver started at http://127.22.4.254:40501/ using document root <none> and password file <none>
I20260811 07:32:42.834137 30598 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:42.834218 30598 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:42.834496 30598 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:42.837368 30598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "b15731bd24134fd2aea6e41f167d0bd1"
format_stamp: "Formatted at 2026-08-11 07:32:42 on dist-test-slave-7z32"
server_key: "666744c4bce459020da34e72fb952e2f"
server_key_iv: "543f092d885d8aaf7d06b7d31bb05474"
server_key_version: "encryptionkey@0"
I20260811 07:32:42.838588 30598 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "b15731bd24134fd2aea6e41f167d0bd1"
format_stamp: "Formatted at 2026-08-11 07:32:42 on dist-test-slave-7z32"
server_key: "666744c4bce459020da34e72fb952e2f"
server_key_iv: "543f092d885d8aaf7d06b7d31bb05474"
server_key_version: "encryptionkey@0"
I20260811 07:32:42.844365 30598 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:32:42.848356 30615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:42.850540 30598 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260811 07:32:42.850919 30598 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b15731bd24134fd2aea6e41f167d0bd1"
format_stamp: "Formatted at 2026-08-11 07:32:42 on dist-test-slave-7z32"
server_key: "666744c4bce459020da34e72fb952e2f"
server_key_iv: "543f092d885d8aaf7d06b7d31bb05474"
server_key_version: "encryptionkey@0"
I20260811 07:32:42.851111 30598 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:42.878037 30598 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:42.879187 30598 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:42.879462 30598 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:42.890213 30598 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:34981
I20260811 07:32:42.890306 30705 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:34981 every 8 connection(s)
I20260811 07:32:42.891729 30598 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:42.893347 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 30598
I20260811 07:32:42.893532 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:42.893960 22547 external_mini_cluster.cc:1428] Setting key 4c4d6eee96ce732827896458d1bf0405
I20260811 07:32:42.896386 30706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:42.902803 30706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1: Bootstrap starting.
I20260811 07:32:42.905498 30706 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:42.906342 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.895813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45074 (local address 127.22.4.254:34981)
0811 07:32:42.896828 (+ 1015us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:42.896852 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:42.896904 (+ 52us) server_negotiation.cc:407] Connection header received
0811 07:32:42.897793 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:42.897816 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:42.898405 (+ 589us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:42.898916 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:42.899490 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:42.900657 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:42.901749 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:42.902353 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:42.902567 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:42.903753 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:42.903759 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:42.903778 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:42.904329 (+ 551us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:42.904413 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:42.904440 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:42.904598 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:42.904775 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 07:32:42.905155 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":215,"threads_started":1}
I20260811 07:32:42.906387 30706 log.cc:824] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:42.909147 30706 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1: No bootstrap required, opened a new log
I20260811 07:32:42.910619 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:32:42.913553 30706 raft_consensus.cc:348] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b15731bd24134fd2aea6e41f167d0bd1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34981 } }
I20260811 07:32:42.913869 30706 raft_consensus.cc:374] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:42.913961 30706 raft_consensus.cc:729] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b15731bd24134fd2aea6e41f167d0bd1, State: Initialized, Role: FOLLOWER
I20260811 07:32:42.914498 30706 consensus_queue.cc:260] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b15731bd24134fd2aea6e41f167d0bd1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34981 } }
I20260811 07:32:42.914669 30706 raft_consensus.cc:388] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:42.914767 30706 raft_consensus.cc:482] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:42.914903 30706 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:42.916226 30706 raft_consensus.cc:504] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b15731bd24134fd2aea6e41f167d0bd1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34981 } }
I20260811 07:32:42.916680 30706 leader_election.cc:302] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b15731bd24134fd2aea6e41f167d0bd1; no voters:
I20260811 07:32:42.917088 30706 leader_election.cc:288] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:42.917327 30714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:42.917785 30714 raft_consensus.cc:686] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [term 1 LEADER]: Becoming Leader. State: Replica: b15731bd24134fd2aea6e41f167d0bd1, State: Running, Role: LEADER
I20260811 07:32:42.918228 30714 consensus_queue.cc:237] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b15731bd24134fd2aea6e41f167d0bd1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34981 } }
I20260811 07:32:42.918661 30706 sys_catalog.cc:564] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:42.920475 30719 sys_catalog.cc:455] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b15731bd24134fd2aea6e41f167d0bd1. Latest consensus state: current_term: 1 leader_uuid: "b15731bd24134fd2aea6e41f167d0bd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b15731bd24134fd2aea6e41f167d0bd1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34981 } } }
I20260811 07:32:42.920662 30719 sys_catalog.cc:458] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:42.921096 30715 sys_catalog.cc:455] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b15731bd24134fd2aea6e41f167d0bd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b15731bd24134fd2aea6e41f167d0bd1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34981 } } }
I20260811 07:32:42.921217 30715 sys_catalog.cc:458] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1 [sys.catalog]: This master's current role is: LEADER
W20260811 07:32:42.925364 30741 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:42.925519 30741 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:42.925683 30733 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:42.926635 30733 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:42.934237 30733 catalog_manager.cc:1347] Generated new cluster ID: f6d8d11974b44a0495d377432b536576
I20260811 07:32:42.934360 30733 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:42.958623 30733 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:42.960085 30733 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:42.975957 30733 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b15731bd24134fd2aea6e41f167d0bd1: Generated new TSK 0
I20260811 07:32:42.977114 30733 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 07:32:43.015344 30761 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 07:32:43.015571 30761 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:32:43.016242 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:42.996014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45082 (local address 127.22.4.254:34981)
0811 07:32:42.996229 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:42.996236 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:42.996519 (+ 283us) server_negotiation.cc:407] Connection header received
0811 07:32:42.996812 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:42.996818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:42.996897 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:42.997178 (+ 281us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:32:42.997459 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:42.998426 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:42.999596 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:42.999985 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.000368 (+ 383us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:43.000859 (+ 491us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:32:43.015678 (+ 14819us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 07:32:43.016069 (+ 391us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45082: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":85}
W20260811 07:32:43.016369 30709 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45082: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 07:32:43.018056 30758 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:42.995854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34981 (local address 127.0.0.1:45082)
0811 07:32:42.996397 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:42.996414 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:42.996585 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:42.997112 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:42.997115 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:42.997123 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:32:42.997318 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:42.997324 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:42.998618 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:42.998621 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:42.999451 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:42.999461 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.000384 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.000388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:43.000473 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:43.000564 (+ 91us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:32:43.016033 (+ 15469us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 07:32:43.016425 (+ 392us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.4.254:34981: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":183,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.22.4.254:34981: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:35425/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 07:32:43.019168 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 30598
2026-08-11T07:32:43Z chronyd exiting
I20260811 07:32:43.073225 22547 test_util.cc:175] -----------------------------------------------
I20260811 07:32:43.073366 22547 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786433529403386-22547-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (443 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 07:32:43.074954 22547 mini_oidc.cc:152] Starting JWKS server
I20260811 07:32:43.076066 22547 webserver.cc:460] Webserver started at https://127.0.0.1:34671/ using document root <none> and password file <none>
I20260811 07:32:43.076169 22547 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:32:43.076545 22547 webserver.cc:460] Webserver started at http://127.0.0.1:34655/ using document root <none> and password file <none>
2026-08-11T07:32:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:43Z Disabled control of system clock
I20260811 07:32:43.092058 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34497
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:41247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34497
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34671/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/testchainca.cert with env {}
W20260811 07:32:43.246471 30768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:43.247061 30768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:43.247148 30768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:43.252640 30768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:43.252786 30768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:43.252820 30768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:43.252869 30768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:43.252936 30768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:32:43.252982 30768 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:32:43.253026 30768 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34671/jwks.json
I20260811 07:32:43.260705 30768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:41247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34497
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34671/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:43.262533 30768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:43.264335 30768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:43.276528 30775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:43.276539 30779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:43.276768 30768 server_base.cc:1034] running on GCE node
W20260811 07:32:43.276528 30776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:43.277961 30768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:43.279452 30768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:43.280714 30768 hybrid_clock.cc:648] HybridClock initialized: now 1786433563280676 us; error 67 us; skew 500 ppm
I20260811 07:32:43.283303 30768 webserver.cc:460] Webserver started at http://127.22.4.254:38949/ using document root <none> and password file <none>
I20260811 07:32:43.284055 30768 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:43.284132 30768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:43.284374 30768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:43.286780 30768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "75379fd2eb51434abc970484e633f497"
format_stamp: "Formatted at 2026-08-11 07:32:43 on dist-test-slave-7z32"
server_key: "659659898bb86b5297f5ab2067c4dab9"
server_key_iv: "2a5ed2140c22bfe34f71d6dc05fb39c5"
server_key_version: "encryptionkey@0"
I20260811 07:32:43.287525 30768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "75379fd2eb51434abc970484e633f497"
format_stamp: "Formatted at 2026-08-11 07:32:43 on dist-test-slave-7z32"
server_key: "659659898bb86b5297f5ab2067c4dab9"
server_key_iv: "2a5ed2140c22bfe34f71d6dc05fb39c5"
server_key_version: "encryptionkey@0"
I20260811 07:32:43.292377 30768 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:32:43.296018 30786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:43.298089 30768 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:43.298434 30768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "75379fd2eb51434abc970484e633f497"
format_stamp: "Formatted at 2026-08-11 07:32:43 on dist-test-slave-7z32"
server_key: "659659898bb86b5297f5ab2067c4dab9"
server_key_iv: "2a5ed2140c22bfe34f71d6dc05fb39c5"
server_key_version: "encryptionkey@0"
I20260811 07:32:43.298599 30768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:43.324293 30768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:43.325152 30768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:43.325403 30768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:43.334203 30768 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:34497
I20260811 07:32:43.334280 30865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:34497 every 8 connection(s)
I20260811 07:32:43.335490 30768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:43.340159 30867 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:43.344017 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 30768
I20260811 07:32:43.344201 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:43.344574 22547 external_mini_cluster.cc:1428] Setting key 4fbc73a3a1924178bddf810a4deef093
I20260811 07:32:43.348379 30867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497: Bootstrap starting.
I20260811 07:32:43.351740 30867 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:43.352944 30867 log.cc:824] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:43.355686 30867 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497: No bootstrap required, opened a new log
I20260811 07:32:43.358220 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:43.346553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38312 (local address 127.22.4.254:34497)
0811 07:32:43.347427 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:43.347452 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:43.347498 (+ 46us) server_negotiation.cc:407] Connection header received
0811 07:32:43.348713 (+ 1215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:43.348741 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:43.349335 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:43.349717 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:43.350380 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.351690 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.353182 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.353863 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.354104 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:43.355353 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:43.355365 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:43.355392 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:43.356101 (+ 709us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:43.356203 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:43.356240 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:43.356385 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:43.356608 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 07:32:43.357204 (+ 596us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":212,"threads_started":1}
I20260811 07:32:43.361032 30867 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75379fd2eb51434abc970484e633f497" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34497 } }
I20260811 07:32:43.361428 30867 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:43.361498 30867 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75379fd2eb51434abc970484e633f497, State: Initialized, Role: FOLLOWER
I20260811 07:32:43.362116 30867 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75379fd2eb51434abc970484e633f497" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34497 } }
I20260811 07:32:43.362317 30867 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:43.362393 30867 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:43.362509 30867 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:43.362491 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:32:43.363809 30867 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75379fd2eb51434abc970484e633f497" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34497 } }
I20260811 07:32:43.364235 30867 leader_election.cc:302] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75379fd2eb51434abc970484e633f497; no voters:
I20260811 07:32:43.364665 30867 leader_election.cc:288] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:43.364864 30875 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:43.365183 30875 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [term 1 LEADER]: Becoming Leader. State: Replica: 75379fd2eb51434abc970484e633f497, State: Running, Role: LEADER
I20260811 07:32:43.365625 30875 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75379fd2eb51434abc970484e633f497" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34497 } }
I20260811 07:32:43.366496 30867 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:43.367772 30877 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75379fd2eb51434abc970484e633f497. Latest consensus state: current_term: 1 leader_uuid: "75379fd2eb51434abc970484e633f497" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75379fd2eb51434abc970484e633f497" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34497 } } }
I20260811 07:32:43.367827 30876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75379fd2eb51434abc970484e633f497" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75379fd2eb51434abc970484e633f497" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34497 } } }
I20260811 07:32:43.367976 30877 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:43.367976 30876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:43.368430 30886 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:43.373246 30886 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:43.379858 30886 catalog_manager.cc:1347] Generated new cluster ID: 069ac0eeba2e43899492a4f4cac456fd
I20260811 07:32:43.379963 30886 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:43.399874 30886 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:43.401610 30886 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:43.415316 30886 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75379fd2eb51434abc970484e633f497: Generated new TSK 0
I20260811 07:32:43.416587 30886 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 07:32:43.454191 30916 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 07:32:43.454413 30916 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 07:32:43.455458 30873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:43.431592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38324 (local address 127.22.4.254:34497)
0811 07:32:43.431820 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:43.431826 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:43.432110 (+ 284us) server_negotiation.cc:407] Connection header received
0811 07:32:43.432427 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:43.432431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:43.432492 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:43.432641 (+ 149us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:32:43.432960 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.433612 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.434652 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.435009 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.435144 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:43.435539 (+ 395us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:32:43.454781 (+ 19242us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34671/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 07:32:43.455248 (+ 467us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38324: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34671/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":84}
W20260811 07:32:43.455576 30873 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38324: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34671/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 07:32:43.455691 30915 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:43.431459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34497 (local address 127.0.0.1:38324)
0811 07:32:43.431997 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:43.432011 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:43.432185 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:43.432637 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:43.432641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:43.432650 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:32:43.432824 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:43.432832 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.433753 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.433757 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:43.434509 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:43.434517 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.435168 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.435172 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:43.435274 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:43.435305 (+ 31us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:32:43.455205 (+ 19900us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34671/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 07:32:43.455442 (+ 237us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.4.254:34497: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34671/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":178,"threads_started":1}
I20260811 07:32:43.456405 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 30768
2026-08-11T07:32:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (432 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 07:32:43.507700 22547 mini_oidc.cc:152] Starting JWKS server
I20260811 07:32:43.509179 22547 webserver.cc:460] Webserver started at https://127.0.0.1:36975/ using document root <none> and password file <none>
I20260811 07:32:43.509327 22547 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 07:32:43.509675 22547 webserver.cc:460] Webserver started at http://127.0.0.1:37267/ using document root <none> and password file <none>
2026-08-11T07:32:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:43Z Disabled control of system clock
I20260811 07:32:43.523741 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:35929
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:35249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:35929
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36975/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 07:32:43.659922 30925 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:43.660256 30925 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:43.660307 30925 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:43.664587 30925 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:43.664670 30925 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:43.664687 30925 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:43.664705 30925 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:43.664721 30925 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:32:43.664738 30925 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:32:43.664752 30925 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36975/jwks.json
I20260811 07:32:43.669884 30925 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:35249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:35929
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:35929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36975/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30925
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:43.671188 30925 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:43.672763 30925 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:43.684330 30935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:43.684521 30932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:43.684355 30931 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:43.684903 30925 server_base.cc:1034] running on GCE node
I20260811 07:32:43.685637 30925 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:43.687331 30925 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:43.688673 30925 hybrid_clock.cc:648] HybridClock initialized: now 1786433563688627 us; error 66 us; skew 500 ppm
I20260811 07:32:43.691256 30925 webserver.cc:460] Webserver started at http://127.22.4.254:43839/ using document root <none> and password file <none>
I20260811 07:32:43.691915 30925 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:43.692013 30925 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:43.692212 30925 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:43.694612 30925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "4f5d9a98a570414e867621a9becc3d1e"
format_stamp: "Formatted at 2026-08-11 07:32:43 on dist-test-slave-7z32"
server_key: "3f457241c398268c92cde8e11e2c4882"
server_key_iv: "d042cc620e3273c330a5d50e52663476"
server_key_version: "encryptionkey@0"
I20260811 07:32:43.695364 30925 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "4f5d9a98a570414e867621a9becc3d1e"
format_stamp: "Formatted at 2026-08-11 07:32:43 on dist-test-slave-7z32"
server_key: "3f457241c398268c92cde8e11e2c4882"
server_key_iv: "d042cc620e3273c330a5d50e52663476"
server_key_version: "encryptionkey@0"
I20260811 07:32:43.700268 30925 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:32:43.703876 30944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:43.705842 30925 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:43.706034 30925 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "4f5d9a98a570414e867621a9becc3d1e"
format_stamp: "Formatted at 2026-08-11 07:32:43 on dist-test-slave-7z32"
server_key: "3f457241c398268c92cde8e11e2c4882"
server_key_iv: "d042cc620e3273c330a5d50e52663476"
server_key_version: "encryptionkey@0"
I20260811 07:32:43.706173 30925 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:43.732085 30925 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:43.732829 30925 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:43.733019 30925 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:43.742040 30925 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:35929
I20260811 07:32:43.742079 31012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:35929 every 8 connection(s)
I20260811 07:32:43.743300 30925 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:43.744503 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 30925
I20260811 07:32:43.744664 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:43.744997 22547 external_mini_cluster.cc:1428] Setting key 156f586be9b20ca6b8e7c2cb340662a8
I20260811 07:32:43.748761 31013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:43.756675 31017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:43.746752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49554 (local address 127.22.4.254:35929)
0811 07:32:43.747661 (+ 909us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:43.747679 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:43.747722 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:32:43.748447 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:43.748466 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:43.748976 (+ 510us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:43.749351 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:43.749782 (+ 431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.750806 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.752427 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.753006 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.753160 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:43.754390 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:43.754397 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:43.754414 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:43.755015 (+ 601us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:43.755087 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:43.755111 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:43.755209 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:43.755444 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 07:32:43.755821 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":190,"threads_started":1}
I20260811 07:32:43.758119 31013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e: Bootstrap starting.
I20260811 07:32:43.761097 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:32:43.762238 31013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:43.763481 31013 log.cc:824] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:43.766953 31013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e: No bootstrap required, opened a new log
I20260811 07:32:43.771921 31013 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5d9a98a570414e867621a9becc3d1e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35929 } }
I20260811 07:32:43.772380 31013 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:43.772449 31013 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f5d9a98a570414e867621a9becc3d1e, State: Initialized, Role: FOLLOWER
I20260811 07:32:43.773101 31013 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5d9a98a570414e867621a9becc3d1e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35929 } }
I20260811 07:32:43.773273 31013 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:43.773336 31013 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:43.773435 31013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:43.774765 31013 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5d9a98a570414e867621a9becc3d1e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35929 } }
I20260811 07:32:43.775270 31013 leader_election.cc:302] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f5d9a98a570414e867621a9becc3d1e; no voters:
I20260811 07:32:43.775686 31013 leader_election.cc:288] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:43.775951 31020 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:43.776422 31020 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [term 1 LEADER]: Becoming Leader. State: Replica: 4f5d9a98a570414e867621a9becc3d1e, State: Running, Role: LEADER
I20260811 07:32:43.776870 31020 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5d9a98a570414e867621a9becc3d1e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35929 } }
I20260811 07:32:43.777539 31013 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:43.779186 31023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f5d9a98a570414e867621a9becc3d1e. Latest consensus state: current_term: 1 leader_uuid: "4f5d9a98a570414e867621a9becc3d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5d9a98a570414e867621a9becc3d1e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35929 } } }
I20260811 07:32:43.779369 31023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:43.779661 31021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f5d9a98a570414e867621a9becc3d1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f5d9a98a570414e867621a9becc3d1e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35929 } } }
I20260811 07:32:43.779829 31021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:43.780802 31033 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:43.785470 31033 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:43.793792 31033 catalog_manager.cc:1347] Generated new cluster ID: a87b06aa345e4995816657a8605a1e20
I20260811 07:32:43.793905 31033 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:43.814078 31033 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:43.815564 31033 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:43.822196 31033 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f5d9a98a570414e867621a9becc3d1e: Generated new TSK 0
I20260811 07:32:43.823398 31033 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:32:43.853052 31017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:43.846251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49556 (local address 127.22.4.254:35929)
0811 07:32:43.846455 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:43.846461 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:43.846663 (+ 202us) server_negotiation.cc:407] Connection header received
0811 07:32:43.846929 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:43.846934 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:43.847022 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:43.847200 (+ 178us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:32:43.847542 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.848446 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.849560 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.849929 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.850253 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:43.850676 (+ 423us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:32:43.852569 (+ 1893us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36975/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 07:32:43.852869 (+ 300us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49556: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36975/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 07:32:43.853152 31017 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49556: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36975/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 07:32:43.854760 31057 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:43.846043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35929 (local address 127.0.0.1:49556)
0811 07:32:43.846544 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:43.846559 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:43.846710 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:43.847238 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:43.847242 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:43.847250 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:32:43.847399 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:43.847405 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.848633 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.848636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:43.849417 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:43.849425 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:43.850279 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:43.850282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:43.850360 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:43.850397 (+ 37us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:32:43.852784 (+ 2387us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36975/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 07:32:43.854518 (+ 1734us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.4.254:35929: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36975/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":1456,"thread_start_us":188,"threads_started":1}
I20260811 07:32:43.855338 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 30925
E20260811 07:32:43.875708 31058 webserver.cc:533] Webserver: sslize failed:
E20260811 07:32:43.875886 31058 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T07:32:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (406 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T07:32:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:43Z Disabled control of system clock
I20260811 07:32:43.929059 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37599
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:43633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:37599
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/testchainca.cert with env {}
W20260811 07:32:44.066728 31065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:44.067186 31065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:44.067282 31065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:44.071732 31065 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:44.071872 31065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:44.071902 31065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:44.071934 31065 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:44.071969 31065 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 07:32:44.072013 31065 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 07:32:44.072044 31065 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 07:32:44.078166 31065 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:43633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:37599
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:44.079523 31065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:44.080713 31065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:44.090694 31071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:44.090696 31070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:44.090760 31073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:44.091017 31065 server_base.cc:1034] running on GCE node
I20260811 07:32:44.091852 31065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:44.093143 31065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:44.094375 31065 hybrid_clock.cc:648] HybridClock initialized: now 1786433564094340 us; error 60 us; skew 500 ppm
I20260811 07:32:44.096652 31065 webserver.cc:460] Webserver started at http://127.22.4.254:33345/ using document root <none> and password file <none>
I20260811 07:32:44.097321 31065 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:44.097430 31065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:44.097699 31065 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:44.100060 31065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "293378feb4e145f690779be8b5f015fc"
format_stamp: "Formatted at 2026-08-11 07:32:44 on dist-test-slave-7z32"
server_key: "18ab4f99c6946984c187ee2163522591"
server_key_iv: "d0740e8a26b15ca6c5f48ec7c26f8535"
server_key_version: "encryptionkey@0"
I20260811 07:32:44.100754 31065 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "293378feb4e145f690779be8b5f015fc"
format_stamp: "Formatted at 2026-08-11 07:32:44 on dist-test-slave-7z32"
server_key: "18ab4f99c6946984c187ee2163522591"
server_key_iv: "d0740e8a26b15ca6c5f48ec7c26f8535"
server_key_version: "encryptionkey@0"
I20260811 07:32:44.105366 31065 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:32:44.108592 31080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:44.110355 31065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260811 07:32:44.110584 31065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "293378feb4e145f690779be8b5f015fc"
format_stamp: "Formatted at 2026-08-11 07:32:44 on dist-test-slave-7z32"
server_key: "18ab4f99c6946984c187ee2163522591"
server_key_iv: "d0740e8a26b15ca6c5f48ec7c26f8535"
server_key_version: "encryptionkey@0"
I20260811 07:32:44.110737 31065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:44.123224 31065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:44.124030 31065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:44.124253 31065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:44.133841 31065 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:37599
I20260811 07:32:44.133884 31152 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:37599 every 8 connection(s)
I20260811 07:32:44.135394 31065 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:44.139503 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 31065
I20260811 07:32:44.139487 31153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:44.139645 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:44.140080 22547 external_mini_cluster.cc:1428] Setting key 328165b3ecbe43aeebadc40b49780fbb
I20260811 07:32:44.147621 31153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc: Bootstrap starting.
I20260811 07:32:44.150748 31153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:44.151813 31153 log.cc:824] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:44.152982 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:44.142265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38038 (local address 127.22.4.254:37599)
0811 07:32:44.143240 (+ 975us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:44.143262 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:44.143313 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:32:44.144190 (+ 877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:44.144215 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:44.144755 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:44.145168 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:44.145709 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:44.147254 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:44.148569 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:44.149324 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:44.149519 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:44.150571 (+ 1052us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:44.150581 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:44.150603 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:32:44.151223 (+ 620us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:44.151306 (+ 83us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:32:44.151336 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:44.151460 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:44.151692 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 07:32:44.152023 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":428,"thread_start_us":179,"threads_started":1}
I20260811 07:32:44.154608 31153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc: No bootstrap required, opened a new log
I20260811 07:32:44.157274 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:32:44.158989 31153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293378feb4e145f690779be8b5f015fc" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37599 } }
I20260811 07:32:44.159397 31153 raft_consensus.cc:374] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:44.159535 31153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 293378feb4e145f690779be8b5f015fc, State: Initialized, Role: FOLLOWER
I20260811 07:32:44.160145 31153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293378feb4e145f690779be8b5f015fc" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37599 } }
I20260811 07:32:44.160310 31153 raft_consensus.cc:388] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:44.160406 31153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:44.160552 31153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:44.161612 31153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293378feb4e145f690779be8b5f015fc" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37599 } }
I20260811 07:32:44.162009 31153 leader_election.cc:302] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 293378feb4e145f690779be8b5f015fc; no voters:
I20260811 07:32:44.162449 31153 leader_election.cc:288] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:44.162626 31161 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:44.163179 31161 raft_consensus.cc:686] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [term 1 LEADER]: Becoming Leader. State: Replica: 293378feb4e145f690779be8b5f015fc, State: Running, Role: LEADER
I20260811 07:32:44.163746 31161 consensus_queue.cc:237] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293378feb4e145f690779be8b5f015fc" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37599 } }
I20260811 07:32:44.164016 31153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:44.166560 31163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 293378feb4e145f690779be8b5f015fc. Latest consensus state: current_term: 1 leader_uuid: "293378feb4e145f690779be8b5f015fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293378feb4e145f690779be8b5f015fc" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37599 } } }
I20260811 07:32:44.166605 31162 sys_catalog.cc:455] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "293378feb4e145f690779be8b5f015fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "293378feb4e145f690779be8b5f015fc" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37599 } } }
I20260811 07:32:44.166903 31163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:44.167480 31162 sys_catalog.cc:458] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc [sys.catalog]: This master's current role is: LEADER
W20260811 07:32:44.171010 31176 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:44.171156 31176 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:44.171248 31178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:44.172439 31178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:44.179875 31178 catalog_manager.cc:1347] Generated new cluster ID: 9f60b9ce14114bc3a92c9d685e10df6b
I20260811 07:32:44.180013 31178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:44.215935 31178 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:44.217121 31178 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:44.224326 31178 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 293378feb4e145f690779be8b5f015fc: Generated new TSK 0
I20260811 07:32:44.225175 31178 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:32:44.717445 31157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:44.243034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38044 (local address 127.22.4.254:37599)
0811 07:32:44.243224 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:44.243230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:44.243495 (+ 265us) server_negotiation.cc:407] Connection header received
0811 07:32:44.243669 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:44.243673 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:44.243765 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:44.243960 (+ 195us) server_negotiation.cc:226] Negotiated authn=JWT
0811 07:32:44.244222 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:44.245747 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:44.246901 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:44.247279 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:44.247404 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:44.247825 (+ 421us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 07:32:44.716811 (+468986us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 07:32:44.717268 (+ 457us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:38044: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 07:32:44.717569 31157 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:38044: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 07:32:44.717773 31190 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:44.242885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37599 (local address 127.0.0.1:38044)
0811 07:32:44.243369 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:44.243382 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:44.243499 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:44.243967 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:44.243970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:44.243979 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0811 07:32:44.244087 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:44.244092 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:44.245945 (+ 1853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:44.245949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:44.246707 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:44.246717 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:44.247449 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:44.247452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:44.247531 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:44.247563 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 07:32:44.717186 (+469623us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 07:32:44.717481 (+ 295us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.22.4.254:37599: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":136,"threads_started":1}
I20260811 07:32:44.718860 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 31065
2026-08-11T07:32:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (838 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (149 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (157 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:45 dist-test-slave-7z32 krb5kdc[31206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:45 dist-test-slave-7z32 krb5kdc[31206](info): set up 2 sockets
Aug 11 07:32:45 dist-test-slave-7z32 krb5kdc[31206](info): commencing operation
krb5kdc: starting...
W20260811 07:32:46.451838 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.390s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:46 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:32:46.638185 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:36229
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:36229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:46.812453 31227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:46.812950 31227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:46.813117 31227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:46.818035 31227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:46.818218 31227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:46.818279 31227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:46.818327 31227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:46.818367 31227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:46.826586 31227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:36229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:36229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:46.828514 31227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:46.830765 31227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:46.844633 31239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:46.844707 31235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:46.844686 31234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:46.844799 31227 server_base.cc:1034] running on GCE node
I20260811 07:32:46.847585 31227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:46.849150 31227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:46.852722 31227 hybrid_clock.cc:648] HybridClock initialized: now 1786433566852606 us; error 134 us; skew 500 ppm
Aug 11 07:32:46 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433566, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:46.857764 31227 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:32:46.859515 31227 webserver.cc:460] Webserver started at http://127.22.4.254:36257/ using document root <none> and password file <none>
I20260811 07:32:46.860342 31227 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:46.860458 31227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:46.860790 31227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:46.863895 31227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "8150f7db30dd4ef99cf7f43374494f68"
format_stamp: "Formatted at 2026-08-11 07:32:46 on dist-test-slave-7z32"
server_key: "af511d1ad825880d44fa4da6df549136"
server_key_iv: "b97d834f0168889bdcbe0e6ca5ad210d"
server_key_version: "encryptionkey@0"
I20260811 07:32:46.864756 31227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "8150f7db30dd4ef99cf7f43374494f68"
format_stamp: "Formatted at 2026-08-11 07:32:46 on dist-test-slave-7z32"
server_key: "af511d1ad825880d44fa4da6df549136"
server_key_iv: "b97d834f0168889bdcbe0e6ca5ad210d"
server_key_version: "encryptionkey@0"
I20260811 07:32:46.870455 31227 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:46.875037 31255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:46.877131 31227 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:46.877369 31227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "8150f7db30dd4ef99cf7f43374494f68"
format_stamp: "Formatted at 2026-08-11 07:32:46 on dist-test-slave-7z32"
server_key: "af511d1ad825880d44fa4da6df549136"
server_key_iv: "b97d834f0168889bdcbe0e6ca5ad210d"
server_key_version: "encryptionkey@0"
I20260811 07:32:46.877547 31227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:46.895124 31227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:46.899431 31227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:46.899694 31227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:46.910079 31227 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:36229
I20260811 07:32:46.910136 31333 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:36229 every 8 connection(s)
I20260811 07:32:46.911587 31227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:46.912896 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 31227
I20260811 07:32:46.913172 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:46.913632 22547 external_mini_cluster.cc:1428] Setting key 857b3730f20fa2276ed0678cf57ebb1c
I20260811 07:32:46.917913 31335 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:46.928277 31335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68: Bootstrap starting.
Aug 11 07:32:46 dist-test-slave-7z32 krb5kdc[31206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:46.932857 31335 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:46.934785 31335 log.cc:824] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:46.938153 31335 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68: No bootstrap required, opened a new log
I20260811 07:32:46.940579 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:46.916210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59764 (local address 127.22.4.254:36229)
0811 07:32:46.917106 (+ 896us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:46.917132 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:46.917191 (+ 59us) server_negotiation.cc:407] Connection header received
0811 07:32:46.918140 (+ 949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:46.918179 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:46.918687 (+ 508us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:46.919156 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:46.920653 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:46.921914 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:46.923606 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:46.924281 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:46.924474 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:46.932619 (+ 8145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:46.932632 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:46.932662 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:46.932731 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:46.936097 (+ 3366us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:46.936952 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:46.936959 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:46.936966 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:46.937143 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:46.937539 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:46.937543 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:46.937544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:46.938141 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:46.938480 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:46.938761 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 07:32:46.939276 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":276,"threads_started":1}
I20260811 07:32:46.942668 31335 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8150f7db30dd4ef99cf7f43374494f68" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36229 } }
I20260811 07:32:46.943334 31335 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:46.943446 31335 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8150f7db30dd4ef99cf7f43374494f68, State: Initialized, Role: FOLLOWER
I20260811 07:32:46.944243 31335 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8150f7db30dd4ef99cf7f43374494f68" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36229 } }
I20260811 07:32:46.944639 31335 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:46.945209 31335 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:46.945375 31335 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:46.947070 31335 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8150f7db30dd4ef99cf7f43374494f68" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36229 } }
I20260811 07:32:46.947724 31335 leader_election.cc:302] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8150f7db30dd4ef99cf7f43374494f68; no voters:
I20260811 07:32:46.948355 31335 leader_election.cc:288] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:46.948580 31342 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:46.949012 31342 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [term 1 LEADER]: Becoming Leader. State: Replica: 8150f7db30dd4ef99cf7f43374494f68, State: Running, Role: LEADER
I20260811 07:32:46.949478 31342 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8150f7db30dd4ef99cf7f43374494f68" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36229 } }
I20260811 07:32:46.950361 31335 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:46.951428 31343 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8150f7db30dd4ef99cf7f43374494f68. Latest consensus state: current_term: 1 leader_uuid: "8150f7db30dd4ef99cf7f43374494f68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8150f7db30dd4ef99cf7f43374494f68" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36229 } } }
I20260811 07:32:46.951634 31343 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:46.951947 31344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8150f7db30dd4ef99cf7f43374494f68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8150f7db30dd4ef99cf7f43374494f68" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36229 } } }
I20260811 07:32:46.952118 31344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68 [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:46.952208 31352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:46.956682 31352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:46.964272 31352 catalog_manager.cc:1347] Generated new cluster ID: fae62bcbe0a94726b9df11409d3f9fa2
I20260811 07:32:46.964411 31352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:46.979080 31352 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:46.980352 31352 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:46.987579 31352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8150f7db30dd4ef99cf7f43374494f68: Generated new TSK 0
I20260811 07:32:46.988533 31352 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:32:47.055315 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36229
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:47.195611 31375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:47.195950 31375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:47.195998 31375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:47.200459 31375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:47.200557 31375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:47.200620 31375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:47.207919 31375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:47.209894 31375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:47.211699 31375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:47.229015 31388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:47.228711 31386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:47.228724 31385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:47.229102 31375 server_base.cc:1034] running on GCE node
I20260811 07:32:47.230393 31375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:47.231822 31375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:47.235262 31375 hybrid_clock.cc:648] HybridClock initialized: now 1786433567235195 us; error 77 us; skew 500 ppm
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.240402 31375 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:32:47.242470 31375 webserver.cc:460] Webserver started at http://127.22.4.193:34481/ using document root <none> and password file <none>
I20260811 07:32:47.243474 31375 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:47.243577 31375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:47.243912 31375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:47.247818 31375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "b4f088f4c96f496989529eec8bf6f329"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "d14a3abc9618553665e9a4d6a840ca76"
server_key_iv: "ea26b05e70b3843f399eccc904eee0d6"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.249253 31375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "b4f088f4c96f496989529eec8bf6f329"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "d14a3abc9618553665e9a4d6a840ca76"
server_key_iv: "ea26b05e70b3843f399eccc904eee0d6"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.258937 31375 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.011s sys 0.000s
I20260811 07:32:47.266717 31401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.270035 31375 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.005s sys 0.000s
I20260811 07:32:47.270260 31375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "b4f088f4c96f496989529eec8bf6f329"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "d14a3abc9618553665e9a4d6a840ca76"
server_key_iv: "ea26b05e70b3843f399eccc904eee0d6"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.270910 31375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:47.298380 31375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:47.302906 31375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:47.303196 31375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:47.304068 31375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:47.305298 31375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:47.305387 31375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.305469 31375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:47.305516 31375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.318528 31375 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:39097
I20260811 07:32:47.318655 31560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:39097 every 8 connection(s)
I20260811 07:32:47.319931 31375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:47.328982 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 31375
I20260811 07:32:47.329167 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:47.329547 22547 external_mini_cluster.cc:1428] Setting key fb601096bc327f1c4fc38efc826ae05c
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:47.339603 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.322632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:36993 (local address 127.22.4.254:36229)
0811 07:32:47.322936 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.322941 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.324128 (+ 1187us) server_negotiation.cc:407] Connection header received
0811 07:32:47.325939 (+ 1811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.325944 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.326030 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.326161 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.327915 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.328863 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.330427 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.330682 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.330859 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.334225 (+ 3366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:47.334229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:47.334232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:47.334264 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:47.336087 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.336783 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.336787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.336789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.336875 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.337449 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.337459 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.337465 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.337893 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:47.338086 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:47.339141 (+ 1055us) server_negotiation.cc:299] Negotiation successful
0811 07:32:47.339362 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:32:47.340782 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.323114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36229 (local address 127.22.4.193:36993)
0811 07:32:47.323813 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:47.323885 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:47.325640 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:47.326426 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:47.326442 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:47.327045 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:47.327734 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:47.327752 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.329071 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.329077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:47.330279 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:47.330293 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.330911 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.330917 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:47.331137 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.332011 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:47.332032 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:47.333971 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:47.336247 (+ 2276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:47.336255 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:47.336283 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:47.336638 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:47.336984 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:47.336987 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:47.336989 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:47.337174 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:47.338133 (+ 959us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:47.338141 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:47.338625 (+ 484us) client_negotiation.cc:769] Sending connection context
0811 07:32:47.339021 (+ 396us) client_negotiation.cc:240] Negotiation successful
0811 07:32:47.339458 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":164,"threads_started":1}
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:32:47.342754 31561 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36229
I20260811 07:32:47.343218 31561 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:47.344022 31561 heartbeater.cc:511] Master 127.22.4.254:36229 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:32:47.347126 31284 ts_manager.cc:194] Registered new tserver with Master: b4f088f4c96f496989529eec8bf6f329 (127.22.4.193:39097)
I20260811 07:32:47.348914 31284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:36993
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:32:47.370132 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36229
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:47.504679 31567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:47.505070 31567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:47.505151 31567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:47.510490 31567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:47.510617 31567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:47.510722 31567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:47.516848 31567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:47.518332 31567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:47.519637 31567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:47.532140 31574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:47.532141 31572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:47.532356 31577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:47.532725 31567 server_base.cc:1034] running on GCE node
I20260811 07:32:47.533337 31567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:47.534099 31567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:47.535386 31567 hybrid_clock.cc:648] HybridClock initialized: now 1786433567535329 us; error 80 us; skew 500 ppm
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.539069 31567 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:32:47.540345 31567 webserver.cc:460] Webserver started at http://127.22.4.194:44377/ using document root <none> and password file <none>
I20260811 07:32:47.541265 31567 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:47.541462 31567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:47.541749 31567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:47.544152 31567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "672a91589bb64d65a3cd41648683e95a"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "4545b760b96f654402ebde29cc81d865"
server_key_iv: "23dce15fcfd90887c5529b393c0d035d"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.544780 31567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "672a91589bb64d65a3cd41648683e95a"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "4545b760b96f654402ebde29cc81d865"
server_key_iv: "23dce15fcfd90887c5529b393c0d035d"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.549933 31567 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:32:47.553843 31589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.555711 31567 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 07:32:47.555912 31567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "672a91589bb64d65a3cd41648683e95a"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "4545b760b96f654402ebde29cc81d865"
server_key_iv: "23dce15fcfd90887c5529b393c0d035d"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.556066 31567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:47.570206 31567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:47.575532 31567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:47.575851 31567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:47.576829 31567 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:47.578102 31567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:47.578164 31567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.578277 31567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:47.578317 31567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.593053 31567 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:41163
I20260811 07:32:47.593163 31759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:41163 every 8 connection(s)
I20260811 07:32:47.594476 31567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:47.601902 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 31567
I20260811 07:32:47.602145 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:47.602543 22547 external_mini_cluster.cc:1428] Setting key 6f6f9d4a93454f6e28c1f403e6abf24f
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:47.614171 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.597280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:35697 (local address 127.22.4.254:36229)
0811 07:32:47.597556 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.597561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.598864 (+ 1303us) server_negotiation.cc:407] Connection header received
0811 07:32:47.600645 (+ 1781us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.600648 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.600721 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.600837 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.602362 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.603046 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.604350 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.604591 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.604720 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.608531 (+ 3811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:47.608538 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:47.608545 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:47.608584 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:47.610644 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.611807 (+ 1163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.611814 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.611819 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.611946 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.612463 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.612468 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.612470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.612754 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:47.612849 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:47.613712 (+ 863us) server_negotiation.cc:299] Negotiation successful
0811 07:32:47.613897 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260811 07:32:47.615548 31763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.597859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36229 (local address 127.22.4.194:35697)
0811 07:32:47.598591 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:47.598665 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:47.600322 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:47.601067 (+ 745us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:47.601076 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:47.601537 (+ 461us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:47.602175 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:47.602195 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.603201 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.603205 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:47.604174 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:47.604185 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.604782 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.604786 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:47.605130 (+ 344us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.605897 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:47.605915 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:47.608240 (+ 2325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:47.611139 (+ 2899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:47.611149 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:47.611173 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:47.611644 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:47.612089 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:47.612093 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:47.612095 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:47.612307 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:47.612952 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:47.612960 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:47.613349 (+ 389us) client_negotiation.cc:769] Sending connection context
0811 07:32:47.613576 (+ 227us) client_negotiation.cc:240] Negotiation successful
0811 07:32:47.614018 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":199,"threads_started":1}
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:47.617512 31760 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36229
I20260811 07:32:47.617861 31760 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:47.618577 31760 heartbeater.cc:511] Master 127.22.4.254:36229 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:32:47.620311 31284 ts_manager.cc:194] Registered new tserver with Master: 672a91589bb64d65a3cd41648683e95a (127.22.4.194:41163)
I20260811 07:32:47.621347 31284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:35697
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:32:47.647606 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36229
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:47.799463 31767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:47.799906 31767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:47.799968 31767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:47.804924 31767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:47.805042 31767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:47.805119 31767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:47.812096 31767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36229
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:47.813786 31767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:47.815299 31767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:47.828037 31775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:47.828016 31777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:47.828025 31780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:47.828374 31767 server_base.cc:1034] running on GCE node
I20260811 07:32:47.829114 31767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:47.830107 31767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:47.831331 31767 hybrid_clock.cc:648] HybridClock initialized: now 1786433567831281 us; error 67 us; skew 500 ppm
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.834753 31767 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:32:47.835959 31767 webserver.cc:460] Webserver started at http://127.22.4.195:39037/ using document root <none> and password file <none>
I20260811 07:32:47.836722 31767 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:47.836833 31767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:47.837121 31767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:47.839756 31767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "1059f7c8d5bb463b8075ced3d3c5fa8f"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "480038421414ec4f1181ad2e46c00e2c"
server_key_iv: "aaf3664ab257bdbf82d426e0fca3544b"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.840408 31767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "1059f7c8d5bb463b8075ced3d3c5fa8f"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "480038421414ec4f1181ad2e46c00e2c"
server_key_iv: "aaf3664ab257bdbf82d426e0fca3544b"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.845134 31767 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:32:47.848646 31790 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.850514 31767 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 07:32:47.850700 31767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "1059f7c8d5bb463b8075ced3d3c5fa8f"
format_stamp: "Formatted at 2026-08-11 07:32:47 on dist-test-slave-7z32"
server_key: "480038421414ec4f1181ad2e46c00e2c"
server_key_iv: "aaf3664ab257bdbf82d426e0fca3544b"
server_key_version: "encryptionkey@0"
I20260811 07:32:47.850879 31767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:47.869689 31767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:47.873487 31767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:47.873827 31767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:47.874560 31767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:47.875648 31767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:47.875730 31767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.875809 31767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:47.875859 31767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:47.888296 31767 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:41185
I20260811 07:32:47.888345 31950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:41185 every 8 connection(s)
I20260811 07:32:47.889519 31767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:47.899923 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 31767
I20260811 07:32:47.900116 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:47.900516 22547 external_mini_cluster.cc:1428] Setting key 622a12683e3ec6653bab87046cea2406
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:32:47.908167 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.893978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:41453 (local address 127.22.4.254:36229)
0811 07:32:47.894206 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.894212 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.894235 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:32:47.895666 (+ 1431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.895670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.895745 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.895858 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.897412 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.898013 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.899373 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.899728 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.899859 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.903741 (+ 3882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:47.903744 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:47.903746 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:47.903777 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:47.905444 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.906192 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.906196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.906198 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.906292 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.906754 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.906757 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.906759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.907049 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:47.907169 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:47.907809 (+ 640us) server_negotiation.cc:299] Negotiation successful
0811 07:32:47.907956 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 07:32:47.909294 31954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.892837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36229 (local address 127.22.4.195:41453)
0811 07:32:47.893526 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:47.893610 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:47.895362 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:47.896104 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:47.896112 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:47.896603 (+ 491us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:47.897228 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:47.897245 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.898167 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.898173 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:47.899228 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:47.899240 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.900002 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.900009 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:47.900373 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.901262 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:47.901282 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:47.903449 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:47.905684 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:47.905693 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:47.905723 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:47.906068 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:47.906394 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:47.906398 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:47.906400 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:47.906635 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:47.907169 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:47.907179 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:47.907516 (+ 337us) client_negotiation.cc:769] Sending connection context
0811 07:32:47.907753 (+ 237us) client_negotiation.cc:240] Negotiation successful
0811 07:32:47.908198 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":170,"threads_started":1}
I20260811 07:32:47.911361 31951 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36229
I20260811 07:32:47.911803 31951 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:47.912581 31951 heartbeater.cc:511] Master 127.22.4.254:36229 requested a full tablet report, sending...
I20260811 07:32:47.914314 31284 ts_manager.cc:194] Registered new tserver with Master: 1059f7c8d5bb463b8075ced3d3c5fa8f (127.22.4.195:41185)
I20260811 07:32:47.915331 31284 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:41453
I20260811 07:32:47.916141 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/test-admin.keytab.
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.941481 22547 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 07:32:47.945977 31959 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:47.943875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49630 (local address 127.22.4.193:39097)
0811 07:32:47.944302 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.944310 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.944343 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:32:47.944413 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.944419 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.944667 (+ 248us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.944817 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.945721 (+ 904us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49630: BlockingRecv error: recv got EOF from 127.0.0.1:49630 (error 108)
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":149,"threads_started":1}
W20260811 07:32:47.946152 22547 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.947707 22547 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.949010 22547 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:47.962373 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.950542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49642 (local address 127.22.4.193:39097)
0811 07:32:47.950731 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.950739 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.950878 (+ 139us) server_negotiation.cc:407] Connection header received
0811 07:32:47.951167 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.951171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.951235 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.951345 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.952206 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.953220 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.954201 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.954694 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.954870 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.957934 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:47.957946 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:47.957967 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:47.957997 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:47.960087 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.960660 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.960672 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.960674 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.960789 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.961101 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.961106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.961108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.961472 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:47.961759 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:47.961961 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 07:32:47.962161 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 07:32:47.968202 31959 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:47.966942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49654 (local address 127.22.4.193:39097)
0811 07:32:47.967118 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.967124 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.967145 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:32:47.967268 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.967272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.967322 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.967430 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.968014 (+ 584us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49654: BlockingRecv error: recv got EOF from 127.0.0.1:49654 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 07:32:47.968611 22547 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.970055 22547 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.971747 22547 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:47.983626 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.973092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49658 (local address 127.22.4.193:39097)
0811 07:32:47.973308 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.973314 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.973533 (+ 219us) server_negotiation.cc:407] Connection header received
0811 07:32:47.973677 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.973680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.973741 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.973831 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.974431 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.975065 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.975998 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.976256 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.976357 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.979264 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:47.979268 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:47.979270 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:47.979304 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:47.980925 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.981548 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.981556 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.981615 (+ 59us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.981757 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.982310 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.982313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.982315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.982655 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:47.982991 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:47.983256 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 07:32:47.983430 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
W20260811 07:32:47.988024 31959 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:47.986537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49664 (local address 127.22.4.193:39097)
0811 07:32:47.986755 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.986761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.986990 (+ 229us) server_negotiation.cc:407] Connection header received
0811 07:32:47.987181 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.987185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.987244 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.987340 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.987865 (+ 525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49664: BlockingRecv error: recv got EOF from 127.0.0.1:49664 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
W20260811 07:32:47.988209 22547 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786433529403386-22547-0/krb5kdc/krb5cc' of type FILE
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.989398 22547 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:47.990402 22547 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 07:32:47 dist-test-slave-7z32 krb5kdc[31206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:32:48.000598 31959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:47.991661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49666 (local address 127.22.4.193:39097)
0811 07:32:47.991868 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:47.991874 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:47.992071 (+ 197us) server_negotiation.cc:407] Connection header received
0811 07:32:47.992247 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:47.992252 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:47.992315 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:47.992431 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:47.993021 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.993552 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.994386 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:47.994627 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:47.994746 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:47.997224 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:47.997228 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:47.997230 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:47.997255 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:47.998784 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.999307 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.999311 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.999312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.999390 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:47.999681 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:47.999685 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:47.999687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:47.999882 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:48.000061 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:48.000293 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 07:32:48.000412 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:32:48.002321 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 31375
I20260811 07:32:48.024485 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 31567
I20260811 07:32:48.081349 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 31767
I20260811 07:32:48.095580 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 31227
2026-08-11T07:32:48Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (3071 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:48 dist-test-slave-7z32 krb5kdc[31979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:48 dist-test-slave-7z32 krb5kdc[31979](info): set up 2 sockets
Aug 11 07:32:48 dist-test-slave-7z32 krb5kdc[31979](info): commencing operation
krb5kdc: starting...
W20260811 07:32:49.523449 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.390s user 0.002s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:49 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:49Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.254.keytab.
Entry for principal oryx/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.254.keytab.
I20260811 07:32:49.696314 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:40787
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.254.keytab
--principal=oryx/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:40787
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:49.862399 31996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:49.862955 31996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:49.863083 31996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:49.867960 31996 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:49.868135 31996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:49.868178 31996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:49.868212 31996 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:49.868249 31996 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:49.875028 31996 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:40787
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.254.keytab
--principal=oryx/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:40787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:49.876717 31996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:49.878219 31996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:49.891129 32007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:49.891278 32008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:49.891129 32010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:49.891909 31996 server_base.cc:1034] running on GCE node
I20260811 07:32:49.892784 31996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:49.894263 31996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:49.897785 31996 hybrid_clock.cc:648] HybridClock initialized: now 1786433569897742 us; error 55 us; skew 500 ppm
Aug 11 07:32:49 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433569, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:49.902037 31996 init.cc:377] Logged in from keytab as oryx/127.22.4.254@KRBTEST.COM (short username oryx)
I20260811 07:32:49.903425 31996 webserver.cc:460] Webserver started at http://127.22.4.254:42161/ using document root <none> and password file <none>
I20260811 07:32:49.904150 31996 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:49.904263 31996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:49.904543 31996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:49.907217 31996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "a7778e725044486791c7184c9a23634a"
format_stamp: "Formatted at 2026-08-11 07:32:49 on dist-test-slave-7z32"
server_key: "4b06b587f42e646e6ddb876ac54c1bf9"
server_key_iv: "2469fe739210eca6e4f5e85c4f8ad9b8"
server_key_version: "encryptionkey@0"
I20260811 07:32:49.907954 31996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "a7778e725044486791c7184c9a23634a"
format_stamp: "Formatted at 2026-08-11 07:32:49 on dist-test-slave-7z32"
server_key: "4b06b587f42e646e6ddb876ac54c1bf9"
server_key_iv: "2469fe739210eca6e4f5e85c4f8ad9b8"
server_key_version: "encryptionkey@0"
I20260811 07:32:49.913240 31996 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:32:49.917199 32020 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:49.919257 31996 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:32:49.919504 31996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "a7778e725044486791c7184c9a23634a"
format_stamp: "Formatted at 2026-08-11 07:32:49 on dist-test-slave-7z32"
server_key: "4b06b587f42e646e6ddb876ac54c1bf9"
server_key_iv: "2469fe739210eca6e4f5e85c4f8ad9b8"
server_key_version: "encryptionkey@0"
I20260811 07:32:49.919669 31996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:49.959746 31996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:49.963667 31996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:49.963935 31996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:49.973196 31996 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:40787
I20260811 07:32:49.973534 32084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:40787 every 8 connection(s)
I20260811 07:32:49.974560 31996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:49.979786 32085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:49.980983 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 31996
I20260811 07:32:49.981184 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:49.981592 22547 external_mini_cluster.cc:1428] Setting key 612c9fadde044e4447f1ad40ef6631d3
I20260811 07:32:49.989295 32085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: Bootstrap starting.
I20260811 07:32:49.993456 32085 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: Neither blocks nor log segments found. Creating new log.
Aug 11 07:32:49 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:49.994796 32085 log.cc:824] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:49.998385 32085 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: No bootstrap required, opened a new log
I20260811 07:32:50.002481 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:49.984089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36082 (local address 127.22.4.254:40787)
0811 07:32:49.984958 (+ 869us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:49.984993 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:49.985047 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:32:49.986019 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:49.986044 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:49.986695 (+ 651us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:49.987285 (+ 590us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:49.988520 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:49.989809 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:49.990911 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:49.991507 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:49.991714 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:49.994642 (+ 2928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:49.994649 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:49.994670 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:49.994710 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:49.997439 (+ 2729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:49.998157 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:49.998163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:49.998169 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:49.998335 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:49.998770 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:49.998774 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:49.998776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:49.999483 (+ 707us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:49.999760 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:50.000109 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 07:32:50.000641 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":234,"threads_started":1}
I20260811 07:32:50.005185 32085 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } }
I20260811 07:32:50.005640 32085 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:50.005721 32085 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7778e725044486791c7184c9a23634a, State: Initialized, Role: FOLLOWER
I20260811 07:32:50.006603 32085 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } }
I20260811 07:32:50.006891 32085 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:50.006966 32085 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:50.007084 32085 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:50.008575 32085 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } }
I20260811 07:32:50.009128 32085 leader_election.cc:302] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7778e725044486791c7184c9a23634a; no voters:
I20260811 07:32:50.009619 32085 leader_election.cc:288] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:50.009816 32094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:50.010236 32094 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 1 LEADER]: Becoming Leader. State: Replica: a7778e725044486791c7184c9a23634a, State: Running, Role: LEADER
I20260811 07:32:50.010699 32094 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } }
I20260811 07:32:50.011572 32085 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:50.013005 32096 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7778e725044486791c7184c9a23634a. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } }
I20260811 07:32:50.012998 32095 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } }
I20260811 07:32:50.013204 32095 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:50.013204 32096 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:50.013746 32105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:50.018060 32105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:50.025525 32105 catalog_manager.cc:1347] Generated new cluster ID: 6319e98b920a4054bf79fdb59650bf46
I20260811 07:32:50.025655 32105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:50.038558 32105 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:50.039747 32105 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:50.045184 32105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: Generated new TSK 0
I20260811 07:32:50.045994 32105 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab.
Entry for principal oryx/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab.
I20260811 07:32:50.091652 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40787
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab
--principal=oryx/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:50.235674 32124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:50.236013 32124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:50.236061 32124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:50.240473 32124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:50.240556 32124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:50.240620 32124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:50.246474 32124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab
--principal=oryx/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:50.248142 32124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:50.249378 32124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:50.261250 32130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:50.261250 32131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:50.261291 32133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:50.261595 32124 server_base.cc:1034] running on GCE node
I20260811 07:32:50.262336 32124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:50.263381 32124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:50.264590 32124 hybrid_clock.cc:648] HybridClock initialized: now 1786433570264558 us; error 49 us; skew 500 ppm
Aug 11 07:32:50 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433570, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:50.268579 32124 init.cc:377] Logged in from keytab as oryx/127.22.4.193@KRBTEST.COM (short username oryx)
I20260811 07:32:50.269953 32124 webserver.cc:460] Webserver started at http://127.22.4.193:39739/ using document root <none> and password file <none>
I20260811 07:32:50.270747 32124 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:50.270884 32124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:50.271200 32124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:50.273979 32124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "e539fe74736e4a24b1c909b41a541ad8"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "557c1386beb644b86f72a2093ce8f485"
server_key_iv: "4001d47df6672dbcddc8dbe5b12e7565"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.274766 32124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "e539fe74736e4a24b1c909b41a541ad8"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "557c1386beb644b86f72a2093ce8f485"
server_key_iv: "4001d47df6672dbcddc8dbe5b12e7565"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.280184 32124 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:32:50.284330 32141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.286531 32124 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260811 07:32:50.286803 32124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "e539fe74736e4a24b1c909b41a541ad8"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "557c1386beb644b86f72a2093ce8f485"
server_key_iv: "4001d47df6672dbcddc8dbe5b12e7565"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.287029 32124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:50.318667 32124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:50.323253 32124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:50.323561 32124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:50.324522 32124 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:50.325686 32124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:50.325768 32124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.325852 32124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:50.325898 32124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.338666 32124 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:43063
I20260811 07:32:50.338724 32302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:43063 every 8 connection(s)
I20260811 07:32:50.340003 32124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:50.342756 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 32124
I20260811 07:32:50.342967 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:50.343319 22547 external_mini_cluster.cc:1428] Setting key 7f5639ac949c6e924558882316c2deaf
Aug 11 07:32:50 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433570, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.22.4.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.194@KRBTEST.COM" created.
I20260811 07:32:50.362288 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:50.342748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:49237 (local address 127.22.4.254:40787)
0811 07:32:50.342985 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:50.342990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:50.344280 (+ 1290us) server_negotiation.cc:407] Connection header received
0811 07:32:50.346159 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:50.346163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:50.346244 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:50.346375 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:50.348601 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.349214 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.351418 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.351709 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.351843 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:50.356744 (+ 4901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:50.356748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:50.356751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:50.356785 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:50.358619 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:50.359520 (+ 901us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:50.359526 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:50.359527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:50.359692 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:50.360257 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:50.360260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:50.360262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:50.360647 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:50.360766 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:50.361702 (+ 936us) server_negotiation.cc:299] Negotiation successful
0811 07:32:50.361951 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260811 07:32:50.363377 32307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:50.343308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:49237)
0811 07:32:50.344037 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:50.344108 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:50.345814 (+ 1706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:50.346642 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:50.346651 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:50.347304 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:50.348299 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:50.348330 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.349419 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.349426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:50.351180 (+ 1754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:50.351201 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.352024 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.352033 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:50.352364 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:50.353347 (+ 983us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:50.353379 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:50.356420 (+ 3041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:50.358801 (+ 2381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:50.358810 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:50.358859 (+ 49us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:50.359278 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:50.359894 (+ 616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:50.359898 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:50.359899 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:50.360109 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:50.360815 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:50.360824 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:50.361197 (+ 373us) client_negotiation.cc:769] Sending connection context
0811 07:32:50.361554 (+ 357us) client_negotiation.cc:240] Negotiation successful
0811 07:32:50.362014 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":217,"threads_started":1}
I20260811 07:32:50.365221 32303 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40787
I20260811 07:32:50.365549 32303 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:50.366205 32303 heartbeater.cc:511] Master 127.22.4.254:40787 requested a full tablet report, sending...
I20260811 07:32:50.368281 32042 ts_manager.cc:194] Registered new tserver with Master: e539fe74736e4a24b1c909b41a541ad8 (127.22.4.193:43063)
I20260811 07:32:50.369796 32042 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:49237
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab.
Entry for principal oryx/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab.
I20260811 07:32:50.383482 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40787
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab
--principal=oryx/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:50.539527 32310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:50.539997 32310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:50.540084 32310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:50.546953 32310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:50.547111 32310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:50.547381 32310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:50.556027 32310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab
--principal=oryx/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:50.557842 32310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:50.559788 32310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:50.574038 32322 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:50.574066 32324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:50.574066 32321 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:50.574365 32310 server_base.cc:1034] running on GCE node
I20260811 07:32:50.575304 32310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:50.576249 32310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:50.577464 32310 hybrid_clock.cc:648] HybridClock initialized: now 1786433570577415 us; error 68 us; skew 500 ppm
Aug 11 07:32:50 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433570, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:50.581379 32310 init.cc:377] Logged in from keytab as oryx/127.22.4.194@KRBTEST.COM (short username oryx)
I20260811 07:32:50.582948 32310 webserver.cc:460] Webserver started at http://127.22.4.194:46601/ using document root <none> and password file <none>
I20260811 07:32:50.583781 32310 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:50.583899 32310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:50.584229 32310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:50.588302 32310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "e309c25814f34556a490a282165bedf7"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "76173239434b469a33f2feb13b663d54"
server_key_iv: "ba01b94573c94fcb2d84714efeb90b8e"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.589335 32310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "e309c25814f34556a490a282165bedf7"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "76173239434b469a33f2feb13b663d54"
server_key_iv: "ba01b94573c94fcb2d84714efeb90b8e"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.595822 32310 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 07:32:50.600370 32335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.602697 32310 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260811 07:32:50.602993 32310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "e309c25814f34556a490a282165bedf7"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "76173239434b469a33f2feb13b663d54"
server_key_iv: "ba01b94573c94fcb2d84714efeb90b8e"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.603184 32310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:50.627888 32310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:50.633083 32310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:50.633390 32310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:50.634321 32310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:50.635666 32310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:50.635759 32310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.635849 32310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:50.635902 32310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.650050 32310 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:34103
I20260811 07:32:50.650089 32490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:34103 every 8 connection(s)
I20260811 07:32:50.651682 32310 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:50.656257 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 32310
I20260811 07:32:50.656517 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:50.656844 22547 external_mini_cluster.cc:1428] Setting key 5c3d181369616cb019d8d49b114c177e
Aug 11 07:32:50 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433570, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for oryx/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:32:50.672852 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:50.654165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:50829 (local address 127.22.4.254:40787)
0811 07:32:50.654389 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:50.654393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:50.655694 (+ 1301us) server_negotiation.cc:407] Connection header received
0811 07:32:50.657830 (+ 2136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:50.657835 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:50.657920 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:50.658064 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:50.660081 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.660731 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.663298 (+ 2567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.663621 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.663769 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:50.668189 (+ 4420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:50.668193 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:50.668195 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:50.668227 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:50.670159 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:50.670964 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:50.670967 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:50.670968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:50.671057 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:50.671461 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:50.671464 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:50.671466 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:50.671704 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:50.671825 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:50.672502 (+ 677us) server_negotiation.cc:299] Negotiation successful
0811 07:32:50.672667 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 07:32:50.674044 32493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:50.654572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:50829)
0811 07:32:50.655410 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:50.655480 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:50.657483 (+ 2003us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:50.658350 (+ 867us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:50.658361 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:50.659117 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:50.659848 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:50.659868 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.660947 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.660952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:50.662981 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:50.663006 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.663912 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.663920 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:50.664265 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:50.665301 (+ 1036us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:50.665337 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:50.667883 (+ 2546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:50.670359 (+ 2476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:50.670369 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:50.670399 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:50.670791 (+ 392us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:50.671163 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:50.671167 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:50.671169 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:50.671349 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:50.671824 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:50.671842 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:50.672226 (+ 384us) client_negotiation.cc:769] Sending connection context
0811 07:32:50.672446 (+ 220us) client_negotiation.cc:240] Negotiation successful
0811 07:32:50.672883 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":249,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.195@KRBTEST.COM" created.
I20260811 07:32:50.675489 32491 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40787
I20260811 07:32:50.675777 32491 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:50.676394 32491 heartbeater.cc:511] Master 127.22.4.254:40787 requested a full tablet report, sending...
I20260811 07:32:50.677572 32042 ts_manager.cc:194] Registered new tserver with Master: e309c25814f34556a490a282165bedf7 (127.22.4.194:34103)
I20260811 07:32:50.678189 32042 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:50829
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab.
Entry for principal oryx/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab.
I20260811 07:32:50.700621 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40787
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab
--principal=oryx/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:50.858196 32496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:50.858641 32496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:50.858695 32496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:50.864106 32496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:50.864238 32496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:50.864317 32496 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:50.871104 32496 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab
--principal=oryx/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32496
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:50.872881 32496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:50.874284 32496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:50.887774 32506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:50.887774 32507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:50.888136 32509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:50.888382 32496 server_base.cc:1034] running on GCE node
I20260811 07:32:50.888993 32496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:50.889871 32496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:50.891077 32496 hybrid_clock.cc:648] HybridClock initialized: now 1786433570891043 us; error 54 us; skew 500 ppm
Aug 11 07:32:50 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433570, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:50.895052 32496 init.cc:377] Logged in from keytab as oryx/127.22.4.195@KRBTEST.COM (short username oryx)
I20260811 07:32:50.896426 32496 webserver.cc:460] Webserver started at http://127.22.4.195:37065/ using document root <none> and password file <none>
I20260811 07:32:50.897248 32496 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:50.897363 32496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:50.897676 32496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:50.900628 32496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "bca089e6298e48a0a1d4fd8e13ad1fab"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "19c90a16765cb8e94860126a05a8ec5c"
server_key_iv: "0effef0ec36be8bee6ece81788e9f27b"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.901467 32496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "bca089e6298e48a0a1d4fd8e13ad1fab"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "19c90a16765cb8e94860126a05a8ec5c"
server_key_iv: "0effef0ec36be8bee6ece81788e9f27b"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.907263 32496 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 07:32:50.911365 32522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.913457 32496 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:50.913700 32496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "bca089e6298e48a0a1d4fd8e13ad1fab"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "19c90a16765cb8e94860126a05a8ec5c"
server_key_iv: "0effef0ec36be8bee6ece81788e9f27b"
server_key_version: "encryptionkey@0"
I20260811 07:32:50.913882 32496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:50.937039 32496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:50.941588 32496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:50.941888 32496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:50.942729 32496 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:50.943913 32496 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:50.943993 32496 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.944074 32496 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:50.944120 32496 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:50.957971 32496 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:44567
I20260811 07:32:50.958035 32694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:44567 every 8 connection(s)
I20260811 07:32:50.959306 32496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:50.964227 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 32496
I20260811 07:32:50.964560 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:50.965121 22547 external_mini_cluster.cc:1428] Setting key 33e3203c5c7692c3624a38402f82c676
Aug 11 07:32:50 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433570, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:50.979319 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:50.962290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:36047 (local address 127.22.4.254:40787)
0811 07:32:50.962465 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:50.962469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:50.963786 (+ 1317us) server_negotiation.cc:407] Connection header received
0811 07:32:50.966272 (+ 2486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:50.966276 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:50.966353 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:50.966456 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:50.968267 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.968989 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.970639 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.971012 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.971148 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:50.974697 (+ 3549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:50.974701 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:50.974703 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:50.974732 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:50.976495 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:50.977192 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:50.977196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:50.977197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:50.977282 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:50.977680 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:50.977685 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:50.977687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:50.977905 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:50.978038 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:50.978897 (+ 859us) server_negotiation.cc:299] Negotiation successful
0811 07:32:50.979116 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:32:50.980495 32698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:50.962705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:36047)
0811 07:32:50.963563 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:50.963634 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:50.965930 (+ 2296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:50.966734 (+ 804us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:50.966747 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:50.967307 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:50.968053 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:50.968073 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.969180 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.969187 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:50.970476 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:50.970491 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:50.971227 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:50.971233 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:50.971440 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:50.972189 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:50.972210 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:50.974455 (+ 2245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:50.976674 (+ 2219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:50.976682 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:50.976717 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:50.977048 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:50.977391 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:50.977395 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:50.977397 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:50.977569 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:50.978038 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:50.978048 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:50.978384 (+ 336us) client_negotiation.cc:769] Sending connection context
0811 07:32:50.978672 (+ 288us) client_negotiation.cc:240] Negotiation successful
0811 07:32:50.979155 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":194,"threads_started":1}
I20260811 07:32:50.982148 32695 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40787
I20260811 07:32:50.982530 32695 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:50.983299 32695 heartbeater.cc:511] Master 127.22.4.254:40787 requested a full tablet report, sending...
I20260811 07:32:50.984973 32039 ts_manager.cc:194] Registered new tserver with Master: bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567)
I20260811 07:32:50.985951 32039 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:36047
I20260811 07:32:50.994465 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.4.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.253.keytab.
Entry for principal oryx/127.22.4.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.253.keytab.
I20260811 07:32:51.035277 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.253:37381
--webserver_interface=127.22.4.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.253.keytab
--principal=oryx/127.22.4.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:40787,127.22.4.253:37381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:51.193167 32702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:51.193591 32702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:51.193640 32702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:51.198427 32702 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:51.198539 32702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:51.198565 32702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:51.198585 32702 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:51.198606 32702 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:51.205760 32702 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:40787,127.22.4.253:37381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.253.keytab
--principal=oryx/127.22.4.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.253:37381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.4.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
W20260811 07:32:51.206116 32702 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.22.4.254:40787,127.22.4.253:37381'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 07:32:51.207515 32702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:51.209039 32702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:51.221931 32711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:51.221931 32713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:51.222023 32710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:51.222304 32702 server_base.cc:1034] running on GCE node
I20260811 07:32:51.223668 32702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:51.225426 32702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:51.226738 32702 hybrid_clock.cc:648] HybridClock initialized: now 1786433571226692 us; error 86 us; skew 500 ppm
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433571, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:51.230708 32702 init.cc:377] Logged in from keytab as oryx/127.22.4.253@KRBTEST.COM (short username oryx)
I20260811 07:32:51.232026 32702 webserver.cc:460] Webserver started at http://127.22.4.253:32777/ using document root <none> and password file <none>
I20260811 07:32:51.232920 32702 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:51.233038 32702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:51.233331 32702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:51.236129 32702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data/instance:
uuid: "66a565e07dc741b7a4c4f557d603d2de"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "beb6cb3ae01701da11d2841afce88c4b"
server_key_iv: "daf5f95dd99857774472e996decf3669"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.236831 32702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal/instance:
uuid: "66a565e07dc741b7a4c4f557d603d2de"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "beb6cb3ae01701da11d2841afce88c4b"
server_key_iv: "daf5f95dd99857774472e996decf3669"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.242003 32702 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:32:51.245430 32726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:51.247682 32702 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 07:32:51.247928 32702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
uuid: "66a565e07dc741b7a4c4f557d603d2de"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "beb6cb3ae01701da11d2841afce88c4b"
server_key_iv: "daf5f95dd99857774472e996decf3669"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.248117 32702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:51.274413 32702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:51.279618 32702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:51.279925 32702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:51.291591 32702 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.253:37381
I20260811 07:32:51.291955 329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.253:37381 every 8 connection(s)
I20260811 07:32:51.293315 32702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
I20260811 07:32:51.297489 331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:51.297470 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 32702
I20260811 07:32:51.303696 331 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.4.253@KRBTEST.COM
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433571, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.253@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:51.320305 335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.299778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.22.4.253:37381)
0811 07:32:51.300451 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.300473 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.300527 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:32:51.301526 (+ 999us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.301551 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.302055 (+ 504us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.302471 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.303798 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.305252 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.306667 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.307940 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.309018 (+ 1078us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.312268 (+ 3250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.312277 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.312294 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.312345 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.315098 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.315856 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.315866 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.315879 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.316054 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.316530 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.316535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.316537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.317189 (+ 652us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.317437 (+ 248us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.318239 (+ 802us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.318957 (+ 718us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":223,"threads_started":1}
I20260811 07:32:51.322716 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.307235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36084 (local address 127.22.4.254:40787)
0811 07:32:51.307439 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.307445 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.308100 (+ 655us) server_negotiation.cc:407] Connection header received
0811 07:32:51.308452 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.308456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.308518 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.308627 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.309943 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.310588 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.312282 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.312600 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.312725 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.316278 (+ 3553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.316285 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.316291 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.316338 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.318233 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.318981 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.318984 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.318986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.319087 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.319545 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.319548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.319549 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.319825 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.321088 (+ 1263us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.322322 (+ 1234us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.322505 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:32:51.322781 336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.307119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36084)
0811 07:32:51.307807 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.307890 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.308225 (+ 335us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.308718 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.308728 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.309435 (+ 707us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.309704 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.309717 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.310813 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.310885 (+ 72us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.312035 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.312075 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.312756 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.312761 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.312928 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.313538 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.313556 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.316002 (+ 2446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.318394 (+ 2392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.318404 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.318412 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.318808 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.319256 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.319259 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.319261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.319365 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.321208 (+ 1843us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.321219 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.321752 (+ 533us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.322223 (+ 471us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.322543 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"spinlock_wait_cycles":7552,"thread_start_us":235,"threads_started":1}
I20260811 07:32:51.325724 331 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433571, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.253@KRBTEST.COM for oryx/127.22.4.253@KRBTEST.COM
I20260811 07:32:51.337711 336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.326923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.0.0.1:54726)
0811 07:32:51.327093 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.327113 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.327234 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.327601 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.327604 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.327844 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.328130 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.328144 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.329610 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.329614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.330301 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.330313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.331079 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.331083 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.331188 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.331869 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.331882 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.333552 (+ 1670us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.335805 (+ 2253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.335808 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.335810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.336101 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.336452 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.336455 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.336456 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.336557 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.337106 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.337109 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.337242 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.337409 (+ 167us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.337558 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 07:32:51.337865 335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.327066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54726 (local address 127.22.4.253:37381)
0811 07:32:51.327258 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.327262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.327284 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:32:51.327342 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.327344 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.327396 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.327524 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.328317 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.329411 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.330532 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.330916 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.331042 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.333746 (+ 2704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.333750 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.333752 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.333787 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.335636 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.336233 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.336237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.336239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.336346 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.336661 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.336664 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.336665 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.336965 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.337077 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.337488 (+ 411us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.337636 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:32:51.343122 331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Bootstrap starting.
I20260811 07:32:51.348567 331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:51.350224 331 log.cc:824] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:51.354118 331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: No bootstrap required, opened a new log
I20260811 07:32:51.360937 331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } }
I20260811 07:32:51.361428 331 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:51.361516 331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66a565e07dc741b7a4c4f557d603d2de, State: Initialized, Role: FOLLOWER
I20260811 07:32:51.362339 331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } }
I20260811 07:32:51.363643 339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } } }
I20260811 07:32:51.363945 339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:51.365217 331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:51.372746 32303 heartbeater.cc:503] Master 127.22.4.254:40787 was elected leader, sending a full tablet report...
W20260811 07:32:51.373869 352 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:51.373986 352 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:51.375867 32702 master_runner.cc:428] Detected that this master 66a565e07dc741b7a4c4f557d603d2de is joining an existing cluster
I20260811 07:32:51.375972 32702 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.4.253:37381
WARNING: no policy specified for oryx/127.22.4.252@KRBTEST.COM; defaulting to no policy
I20260811 07:32:51.401301 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.387603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36094 (local address 127.22.4.254:40787)
0811 07:32:51.387766 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.387771 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.388189 (+ 418us) server_negotiation.cc:407] Connection header received
0811 07:32:51.388401 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.388407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.388469 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.388554 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.389256 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.390102 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.391896 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.392418 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.392534 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.394978 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.394986 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.394992 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.395033 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.397979 (+ 2946us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.398613 (+ 634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.398618 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.398620 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.398732 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.399502 (+ 770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.399513 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.399516 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.400119 (+ 603us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.400281 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.400848 (+ 567us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.401076 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:32:51.402204 364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.387487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36094)
0811 07:32:51.388055 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.388078 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.388274 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.388600 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.388603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.388891 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.389084 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.389093 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.390268 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.390272 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.391687 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.391707 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.392788 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.392795 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.392964 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.394192 (+ 1228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.394214 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.394710 (+ 496us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.398143 (+ 3433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.398150 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.398153 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.398485 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.398917 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.398920 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.398922 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.399030 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.400359 (+ 1329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.400366 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.400556 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.401654 (+ 1098us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.401954 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":409,"mutex_wait_us":3,"thread_start_us":224,"threads_started":1}
I20260811 07:32:51.408002 335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.388351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54742 (local address 127.22.4.253:37381)
0811 07:32:51.388500 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.388505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.389308 (+ 803us) server_negotiation.cc:407] Connection header received
0811 07:32:51.389456 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.389462 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.389542 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.389679 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.390259 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.391275 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.394257 (+ 2982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.394686 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.394911 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.402244 (+ 7333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.402249 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.402252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.402278 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.405517 (+ 3239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.406159 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.406166 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.406168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.406270 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.406642 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.406645 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.406647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.407027 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.407116 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.407617 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.407766 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:32:51.408944 365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.388799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.0.0.1:54742)
0811 07:32:51.389204 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.389221 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.389333 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.389703 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.389707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.389974 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.390122 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.390130 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.393081 (+ 2951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.393086 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.394062 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.394078 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.395550 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.395555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.395732 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.398222 (+ 2490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.398241 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.401996 (+ 3755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.405691 (+ 3695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.405698 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.405704 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.406040 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.406411 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.406417 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.406423 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.406534 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.407188 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.407191 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.407347 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.408507 (+ 1160us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.408761 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":140,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.252@KRBTEST.COM" created.
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433569, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.254@KRBTEST.COM for oryx/127.22.4.253@KRBTEST.COM
I20260811 07:32:51.424144 335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.410509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54756 (local address 127.22.4.253:37381)
0811 07:32:51.410681 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.410685 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.410700 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:32:51.410781 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.410785 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.410919 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.411002 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.412058 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.413223 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.414894 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.415264 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.415352 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.419479 (+ 4127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.419484 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.419486 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.419525 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.421313 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.421961 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.421965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.421967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.422064 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.422385 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.422390 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.422394 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.422667 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.422789 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.423680 (+ 891us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.423859 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 07:32:51.425160 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.409542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.0.0.1:54756)
0811 07:32:51.410015 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.410075 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.410230 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.411168 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.411176 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.411709 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.411875 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.411883 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.413499 (+ 1616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.413503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.414689 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.414702 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.415542 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.415546 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.415671 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.416420 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.416436 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.419216 (+ 2780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.421477 (+ 2261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.421494 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.421504 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.421826 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.422170 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.422174 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.422176 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.422281 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.422807 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.422818 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.423324 (+ 506us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.424567 (+ 1243us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.424875 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":136,"threads_started":1}
I20260811 07:32:51.427845 32039 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.4.253:37381: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de"
member_type: NON_VOTER
last_known_addr {
host: "127.22.4.253"
port: 37381
}
attrs {
promote: true
}
}
dest_uuid: "a7778e725044486791c7184c9a23634a"
cas_config_opid_index: -1
I20260811 07:32:51.428762 32039 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } }
I20260811 07:32:51.431278 375 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 66a565e07dc741b7a4c4f557d603d2de (127.22.4.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } }
I20260811 07:32:51.432782 32766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:51.433593 375 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.4.253:37381
I20260811 07:32:51.433920 375 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } }
I20260811 07:32:51.434044 375 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:51.434410 32702 master.cc:537] Master@127.22.4.253:37381 shutting down...
I20260811 07:32:51.435068 32766 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Refusing update from remote peer a7778e725044486791c7184c9a23634a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 07:32:51.436451 374 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 07:32:51.439383 32024 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 07:32:51.444404 32024 consensus_peers.cc:487] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a -> Peer 66a565e07dc741b7a4c4f557d603d2de (127.22.4.253:37381): Couldn't send request to peer 66a565e07dc741b7a4c4f557d603d2de. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:32:51.444468 32702 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:51.444962 32702 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:51.445091 32702 tablet_replica.cc:330] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: stopping tablet replica
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.252.keytab.
Entry for principal oryx/127.22.4.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.252.keytab.
I20260811 07:32:51.456036 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.252:39539
--webserver_interface=127.22.4.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.252.keytab
--principal=oryx/127.22.4.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:40787,127.22.4.253:37381,127.22.4.252:39539
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:32:51.462924 32702 master.cc:552] Master@127.22.4.253:37381 shutdown complete.
I20260811 07:32:51.463032 32702 master_runner.cc:305] Clearing existing system tablet
I20260811 07:32:51.463397 32702 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:51.463478 32702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:51.465553 32702 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:32:51.467087 383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:51.467521 32702 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:51.467689 32702 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260811 07:32:51.467733 32702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
uuid: "66a565e07dc741b7a4c4f557d603d2de"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "beb6cb3ae01701da11d2841afce88c4b"
server_key_iv: "daf5f95dd99857774472e996decf3669"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.470664 32702 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:51.474141 32702 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 07:32:51.474439 32702 log.cc:1196] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 07:32:51.475069 32702 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Deleting consensus metadata
I20260811 07:32:51.475366 32702 master_runner.cc:315] Copying system tablet from 127.22.4.254:40787
I20260811 07:32:51.477339 32702 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: tablet copy: Beginning tablet copy session from remote peer at address 127.22.4.254:40787
I20260811 07:32:51.490401 389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.478389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36102)
0811 07:32:51.478986 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.479006 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.479190 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.479600 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.479604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.479951 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.480149 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.480158 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.481626 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.481632 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.482660 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.482675 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.483691 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.483695 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.483816 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.484529 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.484546 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.485226 (+ 680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.487705 (+ 2479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.487712 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.487717 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.488151 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.488596 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.488599 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.488602 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.488861 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.489592 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.489596 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.489727 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.489870 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.490097 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":477,"thread_start_us":184,"threads_started":1}
I20260811 07:32:51.490417 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.478738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36102 (local address 127.22.4.254:40787)
0811 07:32:51.478963 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.478969 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.479135 (+ 166us) server_negotiation.cc:407] Connection header received
0811 07:32:51.479343 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.479347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.479420 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.479546 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.480398 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.481417 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.482987 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.483384 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.483477 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.485449 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.485454 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.485458 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.485489 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.487531 (+ 2042us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.488338 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.488342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.488345 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.488456 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.489044 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.489050 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.489052 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.489402 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.489502 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.490003 (+ 501us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.490186 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260811 07:32:51.491958 32066 tablet_copy_service.cc:140] P a7778e725044486791c7184c9a23634a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 66a565e07dc741b7a4c4f557d603d2de ({username='oryx', principal='oryx/127.22.4.253@KRBTEST.COM'} at 127.0.0.1:36102)
I20260811 07:32:51.492238 32066 tablet_copy_service.cc:161] P a7778e725044486791c7184c9a23634a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 66a565e07dc741b7a4c4f557d603d2de at {username='oryx', principal='oryx/127.22.4.253@KRBTEST.COM'} at 127.0.0.1:36102: session id = 66a565e07dc741b7a4c4f557d603d2de-00000000000000000000000000000000
I20260811 07:32:51.494868 32066 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:32:51.497723 32702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 07:32:51.501040 32702 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: tablet copy: Starting download of 0 data blocks...
I20260811 07:32:51.501333 32702 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: tablet copy: Starting download of 1 WAL segments...
I20260811 07:32:51.505164 32702 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:32:51.508021 32066 tablet_copy_service.cc:342] P a7778e725044486791c7184c9a23634a: Request end of tablet copy session 66a565e07dc741b7a4c4f557d603d2de-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.4.253@KRBTEST.COM'} at 127.0.0.1:36102
I20260811 07:32:51.508224 32066 tablet_copy_service.cc:433] P a7778e725044486791c7184c9a23634a: ending tablet copy session 66a565e07dc741b7a4c4f557d603d2de-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 66a565e07dc741b7a4c4f557d603d2de
I20260811 07:32:51.521015 32702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:51.523789 395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:51.523983 390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:51.524221 391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:51.525048 32702 server_base.cc:1034] running on GCE node
I20260811 07:32:51.525309 32702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:51.525766 32702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:51.526916 32702 hybrid_clock.cc:648] HybridClock initialized: now 1786433571526903 us; error 41 us; skew 500 ppm
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433571, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:51.529209 32702 init.cc:377] Logged in from keytab as oryx/127.22.4.253@KRBTEST.COM (short username oryx)
I20260811 07:32:51.529975 32702 webserver.cc:460] Webserver started at http://127.22.4.253:46173/ using document root <none> and password file <none>
I20260811 07:32:51.530249 32702 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:51.530313 32702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:51.532397 32702 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:32:51.534183 405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:51.534792 32702 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:32:51.534940 32702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
uuid: "66a565e07dc741b7a4c4f557d603d2de"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "beb6cb3ae01701da11d2841afce88c4b"
server_key_iv: "daf5f95dd99857774472e996decf3669"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.535068 32702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:51.545228 32702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:51.549727 32702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:51.555526 32702 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.253:37381
I20260811 07:32:51.555581 488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.253:37381 every 8 connection(s)
I20260811 07:32:51.556375 32702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
I20260811 07:32:51.559995 489 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:32:51.561405 489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Bootstrap starting.
I20260811 07:32:51.576879 489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:32:51.577389 489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Bootstrap complete.
I20260811 07:32:51.578228 489 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } }
I20260811 07:32:51.578433 489 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66a565e07dc741b7a4c4f557d603d2de, State: Initialized, Role: LEARNER
I20260811 07:32:51.578562 489 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } }
I20260811 07:32:51.579259 489 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:51.579149 493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } }
I20260811 07:32:51.579501 493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: This master's current role is: LEARNER
I20260811 07:32:51.585215 511 catalog_manager.cc:1259] Loaded cluster ID: 6319e98b920a4054bf79fdb59650bf46
I20260811 07:32:51.585390 511 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: loading cluster ID for follower catalog manager: success
I20260811 07:32:51.588564 511 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: acquiring CA information for follower catalog manager: success
I20260811 07:32:51.590531 511 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 07:32:51.650070 381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:51.650486 381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:51.650539 381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:51.655803 381 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:51.655923 381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:51.655946 381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:51.655965 381 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:51.655983 381 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:51.663159 381 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:40787,127.22.4.253:37381,127.22.4.252:39539
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.252.keytab
--principal=oryx/127.22.4.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.252:39539
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.4.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:51.664829 381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:51.666326 381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:51.678141 522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:51.678213 381 server_base.cc:1034] running on GCE node
W20260811 07:32:51.678179 519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:51.678156 518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:51.679519 381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:51.680513 32491 heartbeater.cc:503] Master 127.22.4.254:40787 was elected leader, sending a full tablet report...
I20260811 07:32:51.681362 381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:51.682585 381 hybrid_clock.cc:648] HybridClock initialized: now 1786433571682547 us; error 67 us; skew 500 ppm
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433571, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:51.686685 381 init.cc:377] Logged in from keytab as oryx/127.22.4.252@KRBTEST.COM (short username oryx)
I20260811 07:32:51.688082 381 webserver.cc:460] Webserver started at http://127.22.4.252:38713/ using document root <none> and password file <none>
I20260811 07:32:51.688736 381 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:51.688808 381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:51.689085 381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:51.692106 381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data/instance:
uuid: "afe45d53d5954086a4921e48450e9425"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "f70e792b06913f23b6a9503701939d68"
server_key_iv: "f94f4eb05363f3662fef580d72216dd1"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.693341 381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal/instance:
uuid: "afe45d53d5954086a4921e48450e9425"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "f70e792b06913f23b6a9503701939d68"
server_key_iv: "f94f4eb05363f3662fef580d72216dd1"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.698758 381 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:51.702342 531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:51.704543 381 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:51.704716 381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
uuid: "afe45d53d5954086a4921e48450e9425"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "f70e792b06913f23b6a9503701939d68"
server_key_iv: "f94f4eb05363f3662fef580d72216dd1"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.704842 381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:51.727834 381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:51.731858 381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:51.732065 381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:51.741145 381 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.252:39539
I20260811 07:32:51.741475 603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.252:39539 every 8 connection(s)
I20260811 07:32:51.742466 381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
I20260811 07:32:51.746779 605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:51.750501 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 381
I20260811 07:32:51.753006 605 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433569, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.4.252@KRBTEST.COM
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433571, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.252@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:51.770259 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.755641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36106 (local address 127.22.4.254:40787)
0811 07:32:51.755841 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.755848 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.756220 (+ 372us) server_negotiation.cc:407] Connection header received
0811 07:32:51.756359 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.756364 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.756430 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.756571 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.759067 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.759744 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.761167 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.761416 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.761550 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.765390 (+ 3840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.765395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.765397 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.765431 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.767452 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.768267 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.768272 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.768275 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.768383 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.768719 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.768723 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.768725 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.768968 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.769099 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.769603 (+ 504us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.770035 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:32:51.771389 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.752703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32928 (local address 127.22.4.252:39539)
0811 07:32:51.753347 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.753368 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.753411 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:32:51.754347 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.754372 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.754812 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.755323 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.756671 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.757930 (+ 1259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.759193 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.759765 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.760064 (+ 299us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.763729 (+ 3665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.763738 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.763756 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.763800 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.766317 (+ 2517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.767338 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.767346 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.767354 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.767563 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.768066 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.768071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.768072 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.768684 (+ 612us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.769096 (+ 412us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.769564 (+ 468us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.769997 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":201,"threads_started":1}
I20260811 07:32:51.771386 610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.755363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36106)
0811 07:32:51.756034 (+ 671us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.756094 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.756232 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.758162 (+ 1930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.758167 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.758630 (+ 463us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.758787 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.758795 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.759970 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.759974 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.760993 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.761009 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.761654 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.761660 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.761787 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.762732 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.762764 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.765116 (+ 2352us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.767598 (+ 2482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.767614 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.767629 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.768071 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.768502 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.768506 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.768508 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.768610 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.769101 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.769112 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.769320 (+ 208us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.769559 (+ 239us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.770153 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":101,"thread_start_us":129,"threads_started":1}
I20260811 07:32:51.773593 605 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433571, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.252@KRBTEST.COM for oryx/127.22.4.253@KRBTEST.COM
I20260811 07:32:51.784794 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.774520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54770 (local address 127.22.4.253:37381)
0811 07:32:51.774989 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.774993 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.775009 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:32:51.775062 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.775064 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.775123 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.775219 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.775860 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.776641 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.777523 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.777787 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.777890 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.781015 (+ 3125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.781020 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.781022 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.781054 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.782739 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.783336 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.783342 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.783344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.783437 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.783749 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.783752 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.783754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.784008 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.784131 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.784430 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.784580 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":156,"threads_started":1}
I20260811 07:32:51.784794 610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.774356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.0.0.1:54770)
0811 07:32:51.774510 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.774530 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.774657 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.775354 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.775357 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.775559 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.775695 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.775701 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.776782 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.776787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.777396 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.777405 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.777939 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.777943 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.778050 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.778750 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.778771 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.780779 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.782938 (+ 2159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.782942 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.782945 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.783213 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.783541 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.783545 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.783547 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.783644 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.784118 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.784122 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.784246 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.784361 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.784603 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 07:32:51.786175 605 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433571, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.252@KRBTEST.COM for oryx/127.22.4.252@KRBTEST.COM
I20260811 07:32:51.797442 610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.787111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:39539 (local address 127.0.0.1:32944)
0811 07:32:51.787276 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.787299 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.787388 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.787707 (+ 319us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.787710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.787919 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.788033 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.788039 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.788965 (+ 926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.788969 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.789787 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.789799 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.791049 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.791053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.791135 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.791701 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.791714 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.793353 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.795633 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.795638 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.795641 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.795909 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.796241 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.796244 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.796245 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.796338 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.796834 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.796837 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.796958 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.797088 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.797249 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 07:32:51.797645 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.787136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32944 (local address 127.22.4.252:39539)
0811 07:32:51.787338 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.787343 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.787364 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:32:51.787497 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.787500 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.787552 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.787637 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.788242 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.788804 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.789921 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.790890 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.791012 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.793543 (+ 2531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.793546 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.793549 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.793579 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.795492 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.796029 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.796033 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.796034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.796128 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.796471 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.796475 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.796476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.796692 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.796788 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.797173 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.797370 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":95}
I20260811 07:32:51.802299 605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Bootstrap starting.
I20260811 07:32:51.805948 605 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:51.807073 605 log.cc:824] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:51.810308 605 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: No bootstrap required, opened a new log
I20260811 07:32:51.815065 605 raft_consensus.cc:348] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } }
I20260811 07:32:51.815429 605 raft_consensus.cc:374] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:51.815474 605 raft_consensus.cc:729] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afe45d53d5954086a4921e48450e9425, State: Initialized, Role: FOLLOWER
I20260811 07:32:51.816414 605 consensus_queue.cc:260] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } }
I20260811 07:32:51.817561 613 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } } }
I20260811 07:32:51.817878 613 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:51.819419 605 sys_catalog.cc:564] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:51.824476 613 raft_consensus.cc:482] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:51.824813 613 raft_consensus.cc:504] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } }
I20260811 07:32:51.826342 613 leader_election.cc:288] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a7778e725044486791c7184c9a23634a (127.22.4.254:40787), 66a565e07dc741b7a4c4f557d603d2de (127.22.4.253:37381)
I20260811 07:32:51.827311 32053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "afe45d53d5954086a4921e48450e9425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a7778e725044486791c7184c9a23634a" is_pre_election: true
W20260811 07:32:51.828450 627 catalog_manager.cc:1558] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:51.828580 627 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:51.828603 440 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "afe45d53d5954086a4921e48450e9425" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66a565e07dc741b7a4c4f557d603d2de" is_pre_election: true
I20260811 07:32:51.828862 440 raft_consensus.cc:1799] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 LEARNER]: Handling vote request from an unknown peer afe45d53d5954086a4921e48450e9425
I20260811 07:32:51.829027 440 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 LEARNER]: Leader pre-election vote request: Denying vote to candidate afe45d53d5954086a4921e48450e9425 for term 1 because replica has last-logged OpId of term: 1 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260811 07:32:51.829152 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 32124
I20260811 07:32:51.829921 535 leader_election.cc:302] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afe45d53d5954086a4921e48450e9425; no voters: 66a565e07dc741b7a4c4f557d603d2de, a7778e725044486791c7184c9a23634a
I20260811 07:32:51.830256 613 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:51.832196 613 raft_consensus.cc:2726] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 07:32:51.833981 381 master_runner.cc:428] Detected that this master afe45d53d5954086a4921e48450e9425 is joining an existing cluster
I20260811 07:32:51.834033 381 master_runner.cc:432] Initiating AddMaster RPC to add 127.22.4.252:39539
I20260811 07:32:51.852926 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.841833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36122 (local address 127.22.4.254:40787)
0811 07:32:51.842016 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.842022 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.842671 (+ 649us) server_negotiation.cc:407] Connection header received
0811 07:32:51.843091 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.843098 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.843176 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.843249 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.844063 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.844714 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.845735 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.846000 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.846141 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.848170 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.848178 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.848185 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.848229 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.850463 (+ 2234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.851118 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.851125 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.851129 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.851227 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.851575 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.851580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.851585 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.851877 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.851968 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.852447 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.852627 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:32:51.853690 639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.842143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36122)
0811 07:32:51.842561 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.842579 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.842756 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.843451 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.843453 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.843738 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.843905 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.843912 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.844847 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.844853 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.845588 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.845597 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.846157 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.846161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.846270 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.847107 (+ 837us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.847131 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.847920 (+ 789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.850646 (+ 2726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.850653 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.850658 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.850976 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.851355 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.851361 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.851366 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.851461 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.852032 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.852037 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.852165 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.853158 (+ 993us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.853383 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":162,"threads_started":1}
I20260811 07:32:51.864264 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.842763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54778 (local address 127.22.4.253:37381)
0811 07:32:51.842947 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.842952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.854038 (+ 11086us) server_negotiation.cc:407] Connection header received
0811 07:32:51.854632 (+ 594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.854638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.854948 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.855034 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.856043 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.856886 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.858076 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.858470 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.858565 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.860349 (+ 1784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.860356 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.860362 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.860393 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.862189 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.862713 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.862719 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.862723 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.862810 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.863121 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.863126 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.863131 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.863387 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.863463 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.863826 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.863998 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:32:51.864918 639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.842998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.0.0.1:54778)
0811 07:32:51.853924 (+ 10926us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.853952 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.854368 (+ 416us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.855237 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.855243 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.855503 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.855895 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.855905 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.857036 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.857041 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.857939 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.857950 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.858771 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.858777 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.858925 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.859626 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.859645 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.860162 (+ 517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.862336 (+ 2174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.862342 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.862346 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.862614 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.862939 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.862944 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.862949 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.863033 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.863516 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.863522 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.863650 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.864467 (+ 817us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.864669 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10813,"thread_start_us":196,"threads_started":1}
I20260811 07:32:51.877954 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.857469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.0.0.1:54794)
0811 07:32:51.857759 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.857782 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.857916 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.872240 (+ 14324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.872247 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.872287 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:51.872454 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.872464 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.873901 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.873908 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.875614 (+ 1706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.875633 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.877196 (+ 1563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.877203 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.877358 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.877439 (+ 81us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.877540 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.877702 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161}
I20260811 07:32:51.878895 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.870602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54794 (local address 127.22.4.253:37381)
0811 07:32:51.871664 (+ 1062us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.871671 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.871692 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:32:51.871766 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.871773 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.871869 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.872018 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:51.872667 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.873713 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.875845 (+ 2132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.876712 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.876843 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.877104 (+ 261us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.878518 (+ 1414us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.878718 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":924}
I20260811 07:32:51.879638 440 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260811 07:32:51.880306 493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7778e725044486791c7184c9a23634a. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } }
I20260811 07:32:51.880448 493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: This master's current role is: LEARNER
Aug 11 07:32:51 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433569, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.254@KRBTEST.COM for oryx/127.22.4.252@KRBTEST.COM
I20260811 07:32:51.886593 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:43063
--local_ip_for_outbound_sockets=127.22.4.193
--tserver_master_addrs=127.22.4.254:40787
--webserver_port=39739
--webserver_interface=127.22.4.193
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab
--principal=oryx/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381,127.22.4.252:39539 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:32:51.908948 367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.877991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:39539 (local address 127.0.0.1:32956)
0811 07:32:51.878289 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.878310 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.878405 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.879156 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.879160 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.879472 (+ 312us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.879613 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.879621 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.881047 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.881051 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.881991 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.882005 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.883310 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.883315 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.883422 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.884161 (+ 739us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.884176 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.885957 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.906444 (+ 20487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.906456 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.906461 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.906971 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.907400 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.907407 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.907412 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.907528 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.908173 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.908177 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.908320 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.908439 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.908685 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":160,"threads_started":1}
I20260811 07:32:51.909386 638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.841115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:39539 (local address 127.0.0.1:32946)
0811 07:32:51.841710 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.841733 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.841883 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.868587 (+ 26704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.868594 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.868968 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.869172 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.869185 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.879466 (+ 10281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.879471 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.880367 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.880380 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.881327 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.881331 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.881427 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.904091 (+ 22664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.904126 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.904846 (+ 720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.907481 (+ 2635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.907484 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.907486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.907755 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.908143 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.908149 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.908153 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.908248 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.908716 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.908718 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.908807 (+ 89us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.908925 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.909123 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":317,"threads_started":1}
I20260811 07:32:51.910148 608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.867906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32946 (local address 127.22.4.252:39539)
0811 07:32:51.868104 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.868111 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.868133 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:32:51.868192 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.868199 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.868272 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.868412 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.871184 (+ 2772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.872061 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.880553 (+ 8492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.880880 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.880986 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.905157 (+ 24171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.905164 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.905169 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.905198 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.907359 (+ 2161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.907863 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.907865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.907867 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.907964 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.908353 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.908356 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.908358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.908573 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.908668 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.909817 (+ 1149us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.909969 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:32:51.911563 644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.878467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32956 (local address 127.22.4.252:39539)
0811 07:32:51.878768 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.878776 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.878792 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:32:51.878905 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.878916 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.878982 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.879743 (+ 761us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.879892 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.880891 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.882414 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.883122 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.883297 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.886251 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.886256 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.886260 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.886303 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.906205 (+ 19902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.907155 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.907160 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.907163 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.907272 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.907683 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.907686 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.907689 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.908040 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.910062 (+ 2022us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.910161 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.910616 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":88,"threads_started":1}
I20260811 07:32:51.912853 32039 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.22.4.252:39539: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "afe45d53d5954086a4921e48450e9425"
member_type: NON_VOTER
last_known_addr {
host: "127.22.4.252"
port: 39539
}
attrs {
promote: true
}
}
dest_uuid: "a7778e725044486791c7184c9a23634a"
cas_config_opid_index: 5
I20260811 07:32:51.913677 32039 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } }
I20260811 07:32:51.915208 374 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER afe45d53d5954086a4921e48450e9425 (127.22.4.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.915881 440 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 LEARNER]: Refusing update from remote peer a7778e725044486791c7184c9a23634a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 07:32:51.917395 374 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.22.4.252:39539
I20260811 07:32:51.917601 646 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 07:32:51.918385 381 master.cc:537] Master@127.22.4.252:39539 shutting down...
I20260811 07:32:51.917618 374 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.919762 374 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
W20260811 07:32:51.920811 32022 consensus_peers.cc:487] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a -> Peer afe45d53d5954086a4921e48450e9425 (127.22.4.252:39539): Couldn't send request to peer afe45d53d5954086a4921e48450e9425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:32:51.922243 440 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER afe45d53d5954086a4921e48450e9425 (127.22.4.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.926132 493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: NON_VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: true } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.926280 493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: This master's current role is: LEARNER
I20260811 07:32:51.927671 374 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: attempting to promote NON_VOTER 66a565e07dc741b7a4c4f557d603d2de to VOTER
I20260811 07:32:51.928300 374 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } }
I20260811 07:32:51.930371 381 raft_consensus.cc:2229] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:51.930773 381 raft_consensus.cc:2258] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 07:32:51.931185 32022 consensus_peers.cc:487] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a -> Peer afe45d53d5954086a4921e48450e9425 (127.22.4.252:39539): Couldn't send request to peer afe45d53d5954086a4921e48450e9425. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 07:32:51.931341 381 tablet_replica.cc:330] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: stopping tablet replica
I20260811 07:32:51.933735 440 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 LEARNER]: Refusing update from remote peer a7778e725044486791c7184c9a23634a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 07:32:51.934553 646 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 07:32:51.938093 375 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 66a565e07dc741b7a4c4f557d603d2de (127.22.4.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.940231 375 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.940397 375 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:51.941061 374 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.941195 374 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:51.941782 449 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 66a565e07dc741b7a4c4f557d603d2de (127.22.4.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.943809 493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:51.943948 493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:51.952822 381 master.cc:552] Master@127.22.4.252:39539 shutdown complete.
I20260811 07:32:51.952947 381 master_runner.cc:305] Clearing existing system tablet
I20260811 07:32:51.953258 381 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:51.953348 381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:51.955387 381 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.001s
I20260811 07:32:51.956669 654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:51.957026 381 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:51.957230 381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 07:32:51.957276 381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
uuid: "afe45d53d5954086a4921e48450e9425"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "f70e792b06913f23b6a9503701939d68"
server_key_iv: "f94f4eb05363f3662fef580d72216dd1"
server_key_version: "encryptionkey@0"
I20260811 07:32:51.960407 381 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:51.964273 381 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 07:32:51.964444 381 log.cc:1196] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 07:32:51.965391 381 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Deleting consensus metadata
I20260811 07:32:51.965921 381 master_runner.cc:315] Copying system tablet from 127.22.4.254:40787
I20260811 07:32:51.967603 381 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: tablet copy: Beginning tablet copy session from remote peer at address 127.22.4.254:40787
I20260811 07:32:51.986655 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.968559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36136 (local address 127.22.4.254:40787)
0811 07:32:51.968751 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:51.968763 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:51.971298 (+ 2535us) server_negotiation.cc:407] Connection header received
0811 07:32:51.971728 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:51.971732 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:51.971823 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:51.971965 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:51.972608 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.973413 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.975085 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.975499 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.975591 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.981795 (+ 6204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:51.981801 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:51.981804 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:51.981845 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:51.983965 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.984704 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.984709 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.984711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.984950 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:51.985370 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:51.985374 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:51.985376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:51.985693 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:51.985799 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:51.986250 (+ 451us) server_negotiation.cc:299] Negotiation successful
0811 07:32:51.986451 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:32:51.987560 662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:51.968448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36136)
0811 07:32:51.971117 (+ 2669us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:51.971135 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:51.971395 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:51.971995 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:51.971999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:51.972310 (+ 311us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:51.972442 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.972449 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.973600 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.973604 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.974886 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:51.974903 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:51.975841 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:51.975845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:51.975982 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:51.980597 (+ 4615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:51.980623 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:51.981500 (+ 877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:51.984200 (+ 2700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.984204 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.984207 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.984557 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.985113 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:51.985116 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:51.985119 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:51.985246 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:51.985872 (+ 626us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:51.985875 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:51.986001 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 07:32:51.987103 (+ 1102us) client_negotiation.cc:240] Negotiation successful
0811 07:32:51.987339 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2553,"thread_start_us":124,"threads_started":1}
I20260811 07:32:51.988226 32066 tablet_copy_service.cc:140] P a7778e725044486791c7184c9a23634a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer afe45d53d5954086a4921e48450e9425 ({username='oryx', principal='oryx/127.22.4.252@KRBTEST.COM'} at 127.0.0.1:36136)
I20260811 07:32:51.988435 32066 tablet_copy_service.cc:161] P a7778e725044486791c7184c9a23634a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer afe45d53d5954086a4921e48450e9425 at {username='oryx', principal='oryx/127.22.4.252@KRBTEST.COM'} at 127.0.0.1:36136: session id = afe45d53d5954086a4921e48450e9425-00000000000000000000000000000000
I20260811 07:32:51.989681 32695 heartbeater.cc:503] Master 127.22.4.254:40787 was elected leader, sending a full tablet report...
I20260811 07:32:51.989846 32066 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 07:32:51.992528 381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 07:32:51.995388 381 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: tablet copy: Starting download of 0 data blocks...
I20260811 07:32:51.995694 381 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: tablet copy: Starting download of 1 WAL segments...
I20260811 07:32:51.997826 381 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 07:32:52.000567 32066 tablet_copy_service.cc:342] P a7778e725044486791c7184c9a23634a: Request end of tablet copy session afe45d53d5954086a4921e48450e9425-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.22.4.252@KRBTEST.COM'} at 127.0.0.1:36136
I20260811 07:32:52.000734 32066 tablet_copy_service.cc:433] P a7778e725044486791c7184c9a23634a: ending tablet copy session afe45d53d5954086a4921e48450e9425-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer afe45d53d5954086a4921e48450e9425
I20260811 07:32:52.012079 381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:52.014912 667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:52.015218 663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:52.015654 665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:52.019205 381 server_base.cc:1034] running on GCE node
I20260811 07:32:52.019559 381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:52.020131 381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:52.021308 381 hybrid_clock.cc:648] HybridClock initialized: now 1786433572021301 us; error 53 us; skew 500 ppm
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:52.023684 381 init.cc:377] Logged in from keytab as oryx/127.22.4.252@KRBTEST.COM (short username oryx)
I20260811 07:32:52.024533 381 webserver.cc:460] Webserver started at http://127.22.4.252:37129/ using document root <none> and password file <none>
I20260811 07:32:52.024971 381 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:52.025079 381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:52.026759 381 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 07:32:52.028469 678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.028800 381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 07:32:52.028918 381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
uuid: "afe45d53d5954086a4921e48450e9425"
format_stamp: "Formatted at 2026-08-11 07:32:51 on dist-test-slave-7z32"
server_key: "f70e792b06913f23b6a9503701939d68"
server_key_iv: "f94f4eb05363f3662fef580d72216dd1"
server_key_version: "encryptionkey@0"
I20260811 07:32:52.029069 381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:52.039613 381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:52.042409 381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:52.050299 381 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.252:39539
I20260811 07:32:52.051067 749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.252:39539 every 8 connection(s)
I20260811 07:32:52.051530 381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
I20260811 07:32:52.054157 750 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:32:52.055446 750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Bootstrap starting.
I20260811 07:32:52.068166 750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:32:52.068609 750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: Bootstrap complete.
I20260811 07:32:52.069299 750 raft_consensus.cc:348] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } }
I20260811 07:32:52.069469 750 raft_consensus.cc:729] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: afe45d53d5954086a4921e48450e9425, State: Initialized, Role: LEARNER
I20260811 07:32:52.069600 750 consensus_queue.cc:260] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } }
I20260811 07:32:52.070047 753 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:52.070247 753 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:32:52.070312 750 sys_catalog.cc:564] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:52.074985 771 catalog_manager.cc:1259] Loaded cluster ID: 6319e98b920a4054bf79fdb59650bf46
I20260811 07:32:52.075083 771 catalog_manager.cc:1552] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: loading cluster ID for follower catalog manager: success
I20260811 07:32:52.077412 771 catalog_manager.cc:1574] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: acquiring CA information for follower catalog manager: success
I20260811 07:32:52.079187 771 catalog_manager.cc:1602] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 07:32:52.088902 645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:52.089236 645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:52.089282 645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:52.093847 645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:52.093956 645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:52.094022 645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:52.099932 645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab
--principal=oryx/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:43063
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=39739
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381,127.22.4.252:39539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:52.101197 645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:52.102344 645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:52.115432 778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:52.115425 780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:52.115425 785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:52.116598 645 server_base.cc:1034] running on GCE node
I20260811 07:32:52.117138 645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:52.117937 645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:52.121394 645 hybrid_clock.cc:648] HybridClock initialized: now 1786433572121340 us; error 68 us; skew 500 ppm
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:52.125607 645 init.cc:377] Logged in from keytab as oryx/127.22.4.193@KRBTEST.COM (short username oryx)
I20260811 07:32:52.126942 645 webserver.cc:460] Webserver started at http://127.22.4.193:39739/ using document root <none> and password file <none>
I20260811 07:32:52.127645 645 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:52.127781 645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:52.132850 645 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260811 07:32:52.136170 792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.138059 645 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:32:52.138298 645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "e539fe74736e4a24b1c909b41a541ad8"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "557c1386beb644b86f72a2093ce8f485"
server_key_iv: "4001d47df6672dbcddc8dbe5b12e7565"
server_key_version: "encryptionkey@0"
I20260811 07:32:52.139128 645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:52.174326 645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:52.178539 645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:52.178860 645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:52.179638 645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:52.180881 645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:52.180955 645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.181013 645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:52.181041 645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.195541 645 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:43063
I20260811 07:32:52.195726 947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:43063 every 8 connection(s)
I20260811 07:32:52.196837 645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:52.206516 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 645
I20260811 07:32:52.206763 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 32310
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.252@KRBTEST.COM
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.253@KRBTEST.COM
I20260811 07:32:52.247335 952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.199350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:54157 (local address 127.22.4.252:39539)
0811 07:32:52.199754 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.199760 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.200755 (+ 995us) server_negotiation.cc:407] Connection header received
0811 07:32:52.202056 (+ 1301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.202060 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.202142 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.202256 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.204129 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.204903 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.234937 (+ 30034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.235368 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.235479 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.241357 (+ 5878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.241368 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.241374 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.241421 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.243393 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.244365 (+ 972us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.244372 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.244376 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.244480 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.245200 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.245207 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.245212 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.245586 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.246291 (+ 705us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.246882 (+ 591us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.247085 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":96,"threads_started":1}
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:52.249372 957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.199874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:39539 (local address 127.22.4.193:54157)
0811 07:32:52.200544 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.200603 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.201776 (+ 1173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.202481 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.202485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.203267 (+ 782us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.203932 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.203950 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.205227 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.205232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.234642 (+ 29410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.234679 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.235790 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.235796 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.236079 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.237587 (+ 1508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.237613 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.240717 (+ 3104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.243746 (+ 3029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.243756 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.243783 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.244235 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.244606 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.244612 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.244617 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.245039 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.245827 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.245836 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.246375 (+ 539us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.247647 (+ 1272us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.248095 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":433,"mutex_wait_us":215,"spinlock_wait_cycles":2304,"thread_start_us":694,"threads_started":1}
I20260811 07:32:52.251926 948 heartbeater.cc:347] Connected to a master server at 127.22.4.252:39539
I20260811 07:32:52.252188 960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.201215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.22.4.193:49391)
0811 07:32:52.201556 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.201572 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.201779 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.202659 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.202664 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.203311 (+ 647us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.203947 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.203957 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.205453 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.205458 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.239481 (+ 34023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.239511 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.240594 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.240600 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.240761 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.242799 (+ 2038us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.242862 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.245112 (+ 2250us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.247585 (+ 2473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.247588 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.247590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.247842 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.248328 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.248335 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.248340 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.248467 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.249195 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.249201 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.249338 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.250969 (+ 1631us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.251172 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":252,"spinlock_wait_cycles":50176,"thread_start_us":233,"threads_started":1}
I20260811 07:32:52.252377 948 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.252462 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.201412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:49391 (local address 127.22.4.253:37381)
0811 07:32:52.201571 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.201576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.201657 (+ 81us) server_negotiation.cc:407] Connection header received
0811 07:32:52.202446 (+ 789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.202450 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.202514 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.202606 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.204147 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.205304 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.239695 (+ 34391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.240222 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.240349 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.245302 (+ 4953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.245307 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.245311 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.245347 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.247436 (+ 2089us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.248014 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.248022 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.248027 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.248180 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.248591 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.248597 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.248601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.248918 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.249015 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.252106 (+ 3091us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.252271 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:32:52.253245 948 heartbeater.cc:511] Master 127.22.4.252:39539 requested a full tablet report, sending...
I20260811 07:32:52.253224 950 heartbeater.cc:347] Connected to a master server at 127.22.4.253:37381
I20260811 07:32:52.253448 950 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.253716 950 heartbeater.cc:511] Master 127.22.4.253:37381 requested a full tablet report, sending...
I20260811 07:32:52.254588 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.199353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:42325 (local address 127.22.4.254:40787)
0811 07:32:52.199542 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.199548 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.201069 (+ 1521us) server_negotiation.cc:407] Connection header received
0811 07:32:52.202041 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.202045 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.202116 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.202183 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.204137 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.205021 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.245024 (+ 40003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.245377 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.245478 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.249615 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.249620 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.249623 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.249655 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.251803 (+ 2148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.253095 (+ 1292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.253099 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.253101 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.253205 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.253575 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.253580 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.253581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.253823 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.253913 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.254269 (+ 356us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.254416 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:32:52.255159 958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.199874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:42325)
0811 07:32:52.200935 (+ 1061us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.200953 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.201779 (+ 826us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.202474 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.202482 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.203311 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.203945 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.203957 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.205216 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.205220 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.244770 (+ 39550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.244799 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.245684 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.245688 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.245809 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.246512 (+ 703us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.246526 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.249411 (+ 2885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.252667 (+ 3256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.252671 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.252673 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.252945 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.253332 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.253335 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.253338 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.253454 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.253977 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.253980 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.254076 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.254800 (+ 724us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.254991 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":958,"mutex_wait_us":416,"spinlock_wait_cycles":68352,"thread_start_us":223,"threads_started":1}
I20260811 07:32:52.255389 434 ts_manager.cc:194] Registered new tserver with Master: e539fe74736e4a24b1c909b41a541ad8 (127.22.4.193:43063)
I20260811 07:32:52.255805 949 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40787
I20260811 07:32:52.255896 949 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.256111 949 heartbeater.cc:511] Master 127.22.4.254:40787 requested a full tablet report, sending...
I20260811 07:32:52.256263 702 ts_manager.cc:194] Registered new tserver with Master: e539fe74736e4a24b1c909b41a541ad8 (127.22.4.193:43063)
I20260811 07:32:52.257061 32039 ts_manager.cc:194] Re-registered known tserver with Master: e539fe74736e4a24b1c909b41a541ad8 (127.22.4.193:43063)
I20260811 07:32:52.257822 32039 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:42325
I20260811 07:32:52.258169 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:34103
--local_ip_for_outbound_sockets=127.22.4.194
--tserver_master_addrs=127.22.4.254:40787
--webserver_port=46601
--webserver_interface=127.22.4.194
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab
--principal=oryx/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381,127.22.4.252:39539 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:52.416414 962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:52.416998 962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:52.417189 962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:52.422690 962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:52.422796 962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:52.422950 962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:52.429833 962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab
--principal=oryx/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:34103
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=46601
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381,127.22.4.252:39539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:52.431437 962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:52.432677 962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:52.445649 968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:52.445673 969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:52.445653 971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:52.446242 962 server_base.cc:1034] running on GCE node
I20260811 07:32:52.446923 962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:52.447775 962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:52.449247 962 hybrid_clock.cc:648] HybridClock initialized: now 1786433572449208 us; error 52 us; skew 500 ppm
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:52.452986 962 init.cc:377] Logged in from keytab as oryx/127.22.4.194@KRBTEST.COM (short username oryx)
I20260811 07:32:52.454459 962 webserver.cc:460] Webserver started at http://127.22.4.194:46601/ using document root <none> and password file <none>
I20260811 07:32:52.455276 962 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:52.455384 962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:52.460623 962 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:32:52.463662 982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.465472 962 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:52.465740 962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "e309c25814f34556a490a282165bedf7"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "76173239434b469a33f2feb13b663d54"
server_key_iv: "ba01b94573c94fcb2d84714efeb90b8e"
server_key_version: "encryptionkey@0"
I20260811 07:32:52.466403 962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:52.489666 962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:52.493570 962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:52.493748 962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:52.494372 962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:52.495498 962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:52.495555 962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.495597 962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:52.495615 962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.507100 962 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:34103
I20260811 07:32:52.507262 1134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:34103 every 8 connection(s)
I20260811 07:32:52.508543 962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:52.510057 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 962
I20260811 07:32:52.510349 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 32496
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.252@KRBTEST.COM
I20260811 07:32:52.536242 952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.511098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:59545 (local address 127.22.4.252:39539)
0811 07:32:52.511741 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.511746 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.514479 (+ 2733us) server_negotiation.cc:407] Connection header received
0811 07:32:52.516496 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.516500 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.516574 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.516701 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.518401 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.519749 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.522274 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.522975 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.523211 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.529127 (+ 5916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.529136 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.529142 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.529190 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.532890 (+ 3700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.533904 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.533908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.533909 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.534016 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.534498 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.534502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.534504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.534775 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.534921 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.535913 (+ 992us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.536061 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539}
I20260811 07:32:52.538465 1144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.511588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:39539 (local address 127.22.4.194:59545)
0811 07:32:52.514266 (+ 2678us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.514333 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.516217 (+ 1884us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.516922 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.516935 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.517488 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.518184 (+ 696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.518208 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.520095 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.520102 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.521996 (+ 1894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.522018 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.523566 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.523576 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.524061 (+ 485us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.526239 (+ 2178us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.526274 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.528784 (+ 2510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.533068 (+ 4284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.533077 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.533104 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.533753 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.534142 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.534145 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.534148 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.534367 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.535000 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.535008 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.535523 (+ 515us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.536812 (+ 1289us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.537292 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2414,"thread_start_us":2210,"threads_started":1}
I20260811 07:32:52.540167 1152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.532712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:39539 (local address 127.0.0.1:32964)
0811 07:32:52.534773 (+ 2061us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.534789 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.534940 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.535394 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.535398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.535416 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:52.535543 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.535550 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.536868 (+ 1318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.536872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.538523 (+ 1651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.538539 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.539741 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.539745 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.539842 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.539865 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.539942 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.540022 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1981,"mutex_wait_us":1,"thread_start_us":66,"threads_started":1}
I20260811 07:32:52.540705 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.533051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32964 (local address 127.22.4.252:39539)
0811 07:32:52.533478 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.533497 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.535031 (+ 1534us) server_negotiation.cc:407] Connection header received
0811 07:32:52.535096 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.535098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.535163 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.535274 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:52.535726 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.536729 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.538694 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.539396 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.539506 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.539666 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.540488 (+ 822us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.540575 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":96,"threads_started":1}
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:52.541582 1135 heartbeater.cc:347] Connected to a master server at 127.22.4.252:39539
I20260811 07:32:52.541594 716 raft_consensus.cc:1203] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260811 07:32:52.542155 753 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7778e725044486791c7184c9a23634a. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:52.542375 753 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: This master's current role is: LEARNER
I20260811 07:32:52.542637 1135 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.543584 1135 heartbeater.cc:511] Master 127.22.4.252:39539 requested a full tablet report, sending...
I20260811 07:32:52.543880 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:44567
--local_ip_for_outbound_sockets=127.22.4.195
--tserver_master_addrs=127.22.4.254:40787
--webserver_port=37065
--webserver_interface=127.22.4.195
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab
--principal=oryx/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381,127.22.4.252:39539 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:32:52.545434 702 ts_manager.cc:194] Registered new tserver with Master: e309c25814f34556a490a282165bedf7 (127.22.4.194:34103)
I20260811 07:32:52.546427 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.526311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:57009 (local address 127.22.4.254:40787)
0811 07:32:52.531174 (+ 4863us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.531181 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.532392 (+ 1211us) server_negotiation.cc:407] Connection header received
0811 07:32:52.532705 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.532713 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.532794 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.532864 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.534228 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.535332 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.536938 (+ 1606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.537389 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.537514 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.542187 (+ 4673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.542192 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.542197 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.542235 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.544405 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.544980 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.544984 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.544986 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.545082 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.545388 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.545392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.545393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.545653 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.545721 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.546104 (+ 383us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.546243 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":4696}
I20260811 07:32:52.547363 1147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.511592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:57009)
0811 07:32:52.532229 (+ 20637us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.532257 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.532529 (+ 272us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.533103 (+ 574us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.533110 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.533822 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.534049 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.534062 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.535540 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.535547 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.536766 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.536783 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.537735 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.537744 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.537902 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.538796 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.539432 (+ 636us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.541975 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.544537 (+ 2562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.544540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.544543 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.544851 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.545193 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.545196 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.545198 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.545283 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.545793 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.545796 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.545910 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.546767 (+ 857us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.547159 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20151,"mutex_wait_us":3278,"thread_start_us":1340,"threads_started":1}
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.253@KRBTEST.COM
I20260811 07:32:52.548584 1137 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40787
I20260811 07:32:52.548717 1137 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.548935 1137 heartbeater.cc:511] Master 127.22.4.254:40787 requested a full tablet report, sending...
I20260811 07:32:52.549714 32039 ts_manager.cc:194] Re-registered known tserver with Master: e309c25814f34556a490a282165bedf7 (127.22.4.194:34103)
I20260811 07:32:52.550546 32039 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:57009
I20260811 07:32:52.554374 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.518813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:57411 (local address 127.22.4.253:37381)
0811 07:32:52.519030 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.519038 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.537625 (+ 18587us) server_negotiation.cc:407] Connection header received
0811 07:32:52.541409 (+ 3784us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.541414 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.541476 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.541535 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.543209 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.544098 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.545614 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.545934 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.546028 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.549333 (+ 3305us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.549342 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.549349 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.549398 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.551793 (+ 2395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.552516 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.552524 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.552529 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.552646 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.553061 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.553067 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.553072 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.553441 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.553555 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.554077 (+ 522us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.554235 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:32:52.554947 1146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.519171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.22.4.194:57411)
0811 07:32:52.537474 (+ 18303us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.537500 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.541227 (+ 3727us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.541711 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.541714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.542125 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.543029 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.543046 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.544493 (+ 1447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.544496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.545428 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.545439 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.546219 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.546223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.546312 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.547059 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.547074 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.549092 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.551974 (+ 2882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.551982 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.551987 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.552357 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.552797 (+ 440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.552803 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.552808 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.552926 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.553639 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.553644 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.553789 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.553931 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.554219 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18170,"thread_start_us":1866,"threads_started":1}
I20260811 07:32:52.555810 1139 heartbeater.cc:347] Connected to a master server at 127.22.4.253:37381
I20260811 07:32:52.555948 1139 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.556200 1139 heartbeater.cc:511] Master 127.22.4.253:37381 requested a full tablet report, sending...
I20260811 07:32:52.557111 434 ts_manager.cc:194] Registered new tserver with Master: e309c25814f34556a490a282165bedf7 (127.22.4.194:34103)
W20260811 07:32:52.705103 1154 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:52.705538 1154 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:52.705639 1154 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:52.710503 1154 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:52.710621 1154 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:52.710731 1154 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:52.717768 1154 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab
--principal=oryx/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:44567
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=37065
--tserver_master_addrs=127.22.4.254:40787,127.22.4.253:37381,127.22.4.252:39539
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1154
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:52.719732 1154 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:52.721309 1154 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:52.734786 1165 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:52.734766 1162 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:52.734740 1161 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:52.734935 1154 server_base.cc:1034] running on GCE node
I20260811 07:32:52.735947 1154 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:52.736908 1154 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:52.738193 1154 hybrid_clock.cc:648] HybridClock initialized: now 1786433572738159 us; error 46 us; skew 500 ppm
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:52.741961 1154 init.cc:377] Logged in from keytab as oryx/127.22.4.195@KRBTEST.COM (short username oryx)
I20260811 07:32:52.743332 1154 webserver.cc:460] Webserver started at http://127.22.4.195:37065/ using document root <none> and password file <none>
I20260811 07:32:52.744184 1154 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:52.744289 1154 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:52.749691 1154 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:32:52.752823 1173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.754686 1154 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 07:32:52.754977 1154 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "bca089e6298e48a0a1d4fd8e13ad1fab"
format_stamp: "Formatted at 2026-08-11 07:32:50 on dist-test-slave-7z32"
server_key: "19c90a16765cb8e94860126a05a8ec5c"
server_key_iv: "0effef0ec36be8bee6ece81788e9f27b"
server_key_version: "encryptionkey@0"
I20260811 07:32:52.755707 1154 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:52.781039 1154 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:52.785657 1154 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:52.785884 1154 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:52.786652 1154 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:32:52.787842 1154 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:52.787900 1154 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.787950 1154 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:52.787966 1154 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:52.802241 1154 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:44567
I20260811 07:32:52.802273 1344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:44567 every 8 connection(s)
I20260811 07:32:52.803833 1154 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:32:52.811058 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 1154
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.252@KRBTEST.COM
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.253@KRBTEST.COM
Aug 11 07:32:52 dist-test-slave-7z32 krb5kdc[31979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433572, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:52.828709 611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.806738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:35549 (local address 127.22.4.253:37381)
0811 07:32:52.806899 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.806905 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.808672 (+ 1767us) server_negotiation.cc:407] Connection header received
0811 07:32:52.810185 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.810214 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.810279 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.810374 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.812789 (+ 2415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.813686 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.816398 (+ 2712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.816736 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.816841 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.822856 (+ 6015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.822860 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.822873 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.822909 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.824961 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.826333 (+ 1372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.826339 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.826342 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.826451 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.827028 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.827032 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.827034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.827310 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.827413 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.828344 (+ 931us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.828499 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:32:52.828845 32091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.809288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:35273 (local address 127.22.4.254:40787)
0811 07:32:52.809466 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.809471 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.809636 (+ 165us) server_negotiation.cc:407] Connection header received
0811 07:32:52.810431 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.810434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.810498 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.810590 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.812741 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.813634 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.816190 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.816515 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.816592 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.821877 (+ 5285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.821882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.821885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.821923 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.825971 (+ 4048us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.826720 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.826725 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.826728 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.826875 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.827258 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.827264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.827266 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.827593 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.827695 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.828367 (+ 672us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.828625 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 07:32:52.830539 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.806728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:44665 (local address 127.22.4.252:39539)
0811 07:32:52.806899 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.806905 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.808391 (+ 1486us) server_negotiation.cc:407] Connection header received
0811 07:32:52.810025 (+ 1634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.810030 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.810124 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.810240 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.812681 (+ 2441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.813707 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.816065 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.816484 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.816605 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.821204 (+ 4599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.821209 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.821212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.821247 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.828261 (+ 7014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.828866 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.828872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.828875 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.828974 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.829340 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.829346 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.829349 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.829580 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.829675 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.830229 (+ 554us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.830383 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:32:52.831252 1351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.807317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.22.4.195:35549)
0811 07:32:52.808578 (+ 1261us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.808594 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.809697 (+ 1103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.810506 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.810520 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.811337 (+ 817us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.812425 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.812451 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.813933 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.813937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.816241 (+ 2304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.816250 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.817018 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.817022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.817214 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.818444 (+ 1230us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.818463 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.822660 (+ 4197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.825593 (+ 2933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.825605 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.825634 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.826172 (+ 538us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.826592 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.826596 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.826602 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.826896 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.827503 (+ 607us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.827511 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.827983 (+ 472us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.829059 (+ 1076us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.829617 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1158,"mutex_wait_us":1302,"spinlock_wait_cycles":109440,"thread_start_us":291,"threads_started":1}
I20260811 07:32:52.831285 1352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.809049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:35273)
0811 07:32:52.809408 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.809425 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.809754 (+ 329us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.811437 (+ 1683us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.811448 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.811658 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.812462 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.812480 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.814352 (+ 1872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.814358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.816010 (+ 1652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.816025 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.816850 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.816855 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.817694 (+ 839us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.819267 (+ 1573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.819282 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.821653 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.826177 (+ 4524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.826182 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.826184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.826545 (+ 361us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.827016 (+ 471us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.827019 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.827022 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.827130 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.827766 (+ 636us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.827769 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.827983 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.829652 (+ 1669us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.829861 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":681,"spinlock_wait_cycles":1408,"thread_start_us":155,"threads_started":1}
I20260811 07:32:52.831809 1358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.814138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36144 (local address 127.22.4.254:40787)
0811 07:32:52.814721 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.814726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.817601 (+ 2875us) server_negotiation.cc:407] Connection header received
0811 07:32:52.817683 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.817686 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.817759 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.817894 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.819093 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.819855 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.824389 (+ 4534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.824892 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.825022 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.826742 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.826745 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.826748 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.826777 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.829251 (+ 2474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.829894 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.829899 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.829901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.830003 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.830342 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.830346 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.830347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.830603 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.830740 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.831467 (+ 727us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.831619 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":88,"threads_started":1}
I20260811 07:32:52.832700 1350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.807317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:39539 (local address 127.22.4.195:44665)
0811 07:32:52.808177 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.808241 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.809697 (+ 1456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.810506 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.810518 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.811375 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:52.812425 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.812452 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.813933 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.813937 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.815888 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.815906 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.816848 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.816853 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.817206 (+ 353us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.818207 (+ 1001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:52.818235 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:52.820947 (+ 2712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:52.828393 (+ 7446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.828396 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.828399 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.828735 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.829103 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:52.829108 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:52.829110 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:52.829225 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:52.829721 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:52.829724 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:52.829819 (+ 95us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.829920 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.830070 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"mutex_wait_us":873,"spinlock_wait_cycles":24064,"thread_start_us":867,"threads_started":1}
I20260811 07:32:52.833684 1346 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40787
I20260811 07:32:52.833767 1347 heartbeater.cc:347] Connected to a master server at 127.22.4.253:37381
I20260811 07:32:52.834122 1346 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.834342 1347 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.834353 1345 heartbeater.cc:347] Connected to a master server at 127.22.4.252:39539
I20260811 07:32:52.834748 1345 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:52.835268 1346 heartbeater.cc:511] Master 127.22.4.254:40787 requested a full tablet report, sending...
I20260811 07:32:52.835266 1345 heartbeater.cc:511] Master 127.22.4.252:39539 requested a full tablet report, sending...
I20260811 07:32:52.835268 1347 heartbeater.cc:511] Master 127.22.4.253:37381 requested a full tablet report, sending...
I20260811 07:32:52.836761 32042 ts_manager.cc:194] Re-registered known tserver with Master: bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567)
I20260811 07:32:52.837642 32042 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:35273
I20260811 07:32:52.837970 1360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.815076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54802 (local address 127.22.4.253:37381)
0811 07:32:52.817506 (+ 2430us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.817513 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.818012 (+ 499us) server_negotiation.cc:407] Connection header received
0811 07:32:52.818062 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.818065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.818126 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.818222 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.820096 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.821082 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.822449 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.822869 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.822978 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.825141 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.825145 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.825148 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.825191 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.835191 (+ 10000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.835737 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.835740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.835741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.835817 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.836244 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.836248 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.836250 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.836657 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.836796 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.837546 (+ 750us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.837689 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2343,"thread_start_us":90,"threads_started":1}
I20260811 07:32:52.838153 952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.813884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32978 (local address 127.22.4.252:39539)
0811 07:32:52.814046 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.814051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.815118 (+ 1067us) server_negotiation.cc:407] Connection header received
0811 07:32:52.815352 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.815356 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.815418 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.815474 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:52.816784 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.817489 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.821161 (+ 3672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.821511 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.821612 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.824883 (+ 3271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:52.824892 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:52.824895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:52.824931 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:52.827409 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.836619 (+ 9210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.836625 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.836626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.836757 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:52.837100 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:52.837104 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:52.837105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:52.837351 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:52.837471 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.837820 (+ 349us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.837969 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:32:52.839733 434 ts_manager.cc:194] Registered new tserver with Master: bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567)
I20260811 07:32:52.840371 702 ts_manager.cc:194] Registered new tserver with Master: bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567)
I20260811 07:32:52.836861 32039 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36144:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:52.843938 32039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:52.848801 1150 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: NON_VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: true } } }
I20260811 07:32:52.849015 1150 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:52.853358 1366 raft_consensus.cc:1050] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: attempting to promote NON_VOTER afe45d53d5954086a4921e48450e9425 to VOTER
I20260811 07:32:52.853852 1366 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } }
I20260811 07:32:52.855386 449 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Refusing update from remote peer a7778e725044486791c7184c9a23634a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 07:32:52.856082 1364 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 07:32:52.856460 716 raft_consensus.cc:1261] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 LEARNER]: Refusing update from remote peer a7778e725044486791c7184c9a23634a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260811 07:32:52.856940 1150 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260811 07:32:52.858517 1364 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, afe45d53d5954086a4921e48450e9425 (127.22.4.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:52.859213 449 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, afe45d53d5954086a4921e48450e9425 (127.22.4.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:52.860020 715 raft_consensus.cc:2932] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, afe45d53d5954086a4921e48450e9425 (127.22.4.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:52.860805 1364 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:52.860976 1364 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:52.861140 1364 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:52.861272 1364 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:52.861387 1364 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:52.861447 1364 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:52.862143 1379 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:52.862382 1379 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:52.863224 753 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "a7778e725044486791c7184c9a23634a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:52.863358 753 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:52.875027 1383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.868206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55732 (local address 127.22.4.193:43063)
0811 07:32:52.868657 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.868666 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.869019 (+ 353us) server_negotiation.cc:407] Connection header received
0811 07:32:52.869146 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.869156 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.869487 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.869700 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:52.870071 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.871569 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.873035 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.874033 (+ 998us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.874160 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.874382 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.874719 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.874895 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":108,"threads_started":1}
I20260811 07:32:52.874996 1385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.867939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:43063 (local address 127.0.0.1:55732)
0811 07:32:52.868763 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.868780 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.868898 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.869677 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.869684 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.869711 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:52.869870 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.869878 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.871760 (+ 1882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.871765 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.872861 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.872874 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.874449 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.874452 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.874529 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.874554 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.874664 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.874767 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":201,"threads_started":1}
I20260811 07:32:52.876097 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.867692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40354 (local address 127.22.4.194:34103)
0811 07:32:52.870513 (+ 2821us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.870542 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.870573 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:32:52.870670 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.870675 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.870930 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.871521 (+ 591us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:52.871723 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.872726 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.874280 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.875288 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.875457 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.875649 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.875790 (+ 141us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.875905 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2630,"thread_start_us":258,"threads_started":1}
I20260811 07:32:52.876066 1152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.867246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:34103 (local address 127.0.0.1:40354)
0811 07:32:52.867677 (+ 431us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.867697 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.867806 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.871129 (+ 3323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.871134 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.871155 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:52.871282 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.871290 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.872876 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.872880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.874127 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.874139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.875464 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.875468 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.875588 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.875616 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.875747 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.875867 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328}
I20260811 07:32:52.878468 1381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.868405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:44567 (local address 127.0.0.1:37560)
0811 07:32:52.869989 (+ 1584us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:52.870006 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:52.870118 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:52.873700 (+ 3582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:52.873704 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:52.873726 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:52.873855 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.873865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.875397 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.875401 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.876692 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:52.876711 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.877949 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.877954 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:52.878057 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.878107 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 07:32:52.878170 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 07:32:52.878280 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1519,"thread_start_us":106,"threads_started":1}
I20260811 07:32:52.879448 1386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:52.868695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37560 (local address 127.22.4.195:44567)
0811 07:32:52.873124 (+ 4429us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:52.873141 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:52.873184 (+ 43us) server_negotiation.cc:407] Connection header received
0811 07:32:52.873278 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:52.873284 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:52.873506 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:52.873731 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:52.873969 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.875258 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.876911 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:52.877772 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:52.878741 (+ 969us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:52.878986 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:52.879073 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 07:32:52.879257 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4283,"thread_start_us":184,"threads_started":1}
I20260811 07:32:52.880777 1043 tablet_service.cc:1467] Processing CreateTablet for tablet bd929b47afa44a10a8993be99878744d (DEFAULT_TABLE table=test-table [id=69d2e85dd4f34b9780523f2c1ffc58ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:52.880062 857 tablet_service.cc:1467] Processing CreateTablet for tablet bd929b47afa44a10a8993be99878744d (DEFAULT_TABLE table=test-table [id=69d2e85dd4f34b9780523f2c1ffc58ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:52.882323 1043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd929b47afa44a10a8993be99878744d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:52.882745 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd929b47afa44a10a8993be99878744d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:52.883285 1250 tablet_service.cc:1467] Processing CreateTablet for tablet bd929b47afa44a10a8993be99878744d (DEFAULT_TABLE table=test-table [id=69d2e85dd4f34b9780523f2c1ffc58ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:52.884583 1250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bd929b47afa44a10a8993be99878744d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:52.891067 1387 tablet_bootstrap.cc:492] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Bootstrap starting.
I20260811 07:32:52.894027 1387 tablet_bootstrap.cc:654] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:52.895078 1387 log.cc:824] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:52.895660 1391 tablet_bootstrap.cc:492] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Bootstrap starting.
I20260811 07:32:52.896067 1388 tablet_bootstrap.cc:492] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Bootstrap starting.
I20260811 07:32:52.898345 1387 tablet_bootstrap.cc:492] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: No bootstrap required, opened a new log
I20260811 07:32:52.898675 1387 ts_tablet_manager.cc:1397] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s
I20260811 07:32:52.899226 1388 tablet_bootstrap.cc:654] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:52.899253 1391 tablet_bootstrap.cc:654] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:52.900283 1388 log.cc:824] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:52.900341 1391 log.cc:824] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:52.903505 1388 tablet_bootstrap.cc:492] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: No bootstrap required, opened a new log
I20260811 07:32:52.903716 1391 tablet_bootstrap.cc:492] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: No bootstrap required, opened a new log
I20260811 07:32:52.903920 1388 ts_tablet_manager.cc:1397] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260811 07:32:52.904014 1391 ts_tablet_manager.cc:1397] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 07:32:52.904845 1387 raft_consensus.cc:348] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:52.905202 1387 raft_consensus.cc:374] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:52.905290 1387 raft_consensus.cc:729] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e309c25814f34556a490a282165bedf7, State: Initialized, Role: FOLLOWER
I20260811 07:32:52.905913 1387 consensus_queue.cc:260] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:52.907127 1137 heartbeater.cc:503] Master 127.22.4.254:40787 was elected leader, sending a full tablet report...
I20260811 07:32:52.907655 1387 ts_tablet_manager.cc:1428] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260811 07:32:52.909986 1391 raft_consensus.cc:348] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:52.910400 1391 raft_consensus.cc:374] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:52.910471 1391 raft_consensus.cc:729] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca089e6298e48a0a1d4fd8e13ad1fab, State: Initialized, Role: FOLLOWER
I20260811 07:32:52.911098 1391 consensus_queue.cc:260] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:52.911229 1388 raft_consensus.cc:348] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:52.911623 1388 raft_consensus.cc:374] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:52.911682 1388 raft_consensus.cc:729] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e539fe74736e4a24b1c909b41a541ad8, State: Initialized, Role: FOLLOWER
I20260811 07:32:52.912365 1388 consensus_queue.cc:260] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:52.913053 1391 ts_tablet_manager.cc:1428] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260811 07:32:52.913561 1346 heartbeater.cc:503] Master 127.22.4.254:40787 was elected leader, sending a full tablet report...
I20260811 07:32:52.913861 1388 ts_tablet_manager.cc:1428] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260811 07:32:52.914340 949 heartbeater.cc:503] Master 127.22.4.254:40787 was elected leader, sending a full tablet report...
W20260811 07:32:52.949074 951 tablet.cc:2369] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:32:53.010509 1140 tablet.cc:2369] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:53.051944 1398 raft_consensus.cc:482] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:53.052287 1398 raft_consensus.cc:504] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:53.053812 1398 leader_election.cc:288] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e309c25814f34556a490a282165bedf7 (127.22.4.194:34103), bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567)
W20260811 07:32:53.055842 1348 tablet.cc:2369] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:53.060178 1400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.054797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:44567 (local address 127.22.4.193:54101)
0811 07:32:53.055239 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:53.055259 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:53.055683 (+ 424us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:53.056172 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:53.056175 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:53.056191 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:53.056310 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:53.056315 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.057270 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.057273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:53.058556 (+ 1283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:53.058568 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.059505 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.059508 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:53.059634 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.059695 (+ 61us) client_negotiation.cc:769] Sending connection context
0811 07:32:53.059827 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 07:32:53.059934 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"mutex_wait_us":11,"thread_start_us":153,"threads_started":1}
I20260811 07:32:53.060204 1386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.054997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:54101 (local address 127.22.4.195:44567)
0811 07:32:53.055127 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:53.055132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:53.055372 (+ 240us) server_negotiation.cc:407] Connection header received
0811 07:32:53.055868 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:53.055873 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:53.055950 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:53.056007 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:53.056434 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.057144 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.058741 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.059258 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.059391 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.059448 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:53.059905 (+ 457us) server_negotiation.cc:299] Negotiation successful
0811 07:32:53.060041 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:32:53.060272 1380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.054466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:34083 (local address 127.22.4.194:34103)
0811 07:32:53.054636 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:53.054641 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:53.055064 (+ 423us) server_negotiation.cc:407] Connection header received
0811 07:32:53.055319 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:53.055327 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:53.055422 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:53.055508 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:53.056036 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.056910 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.058742 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.059484 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.059657 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.059727 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:53.059992 (+ 265us) server_negotiation.cc:299] Negotiation successful
0811 07:32:53.060115 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 07:32:53.060683 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.054264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:34103 (local address 127.22.4.193:34083)
0811 07:32:53.054924 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:53.054943 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:53.055168 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:53.055576 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:53.055582 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:53.055683 (+ 101us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:53.055875 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:53.055883 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.057059 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.057062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:53.058561 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:53.058568 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.059644 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.059647 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:53.059825 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.059846 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:32:53.060443 (+ 597us) client_negotiation.cc:240] Negotiation successful
0811 07:32:53.060530 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":526,"mutex_wait_us":109,"spinlock_wait_cycles":161664,"thread_start_us":199,"threads_started":1}
I20260811 07:32:53.061264 1281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd929b47afa44a10a8993be99878744d" candidate_uuid: "e539fe74736e4a24b1c909b41a541ad8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" is_pre_election: true
I20260811 07:32:53.061291 1073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd929b47afa44a10a8993be99878744d" candidate_uuid: "e539fe74736e4a24b1c909b41a541ad8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e309c25814f34556a490a282165bedf7" is_pre_election: true
I20260811 07:32:53.061691 1281 raft_consensus.cc:2454] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e539fe74736e4a24b1c909b41a541ad8 in term 0.
I20260811 07:32:53.061719 1073 raft_consensus.cc:2454] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e539fe74736e4a24b1c909b41a541ad8 in term 0.
I20260811 07:32:53.062266 796 leader_election.cc:302] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e309c25814f34556a490a282165bedf7, e539fe74736e4a24b1c909b41a541ad8; no voters:
I20260811 07:32:53.062657 1398 raft_consensus.cc:2781] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:53.062813 1398 raft_consensus.cc:482] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:53.062917 1398 raft_consensus.cc:3037] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:53.064539 1398 raft_consensus.cc:504] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:53.065037 1398 leader_election.cc:288] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [CANDIDATE]: Term 1 election: Requested vote from peers e309c25814f34556a490a282165bedf7 (127.22.4.194:34103), bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567)
I20260811 07:32:53.065536 1073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd929b47afa44a10a8993be99878744d" candidate_uuid: "e539fe74736e4a24b1c909b41a541ad8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e309c25814f34556a490a282165bedf7"
I20260811 07:32:53.065726 1073 raft_consensus.cc:3037] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:53.065694 1281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bd929b47afa44a10a8993be99878744d" candidate_uuid: "e539fe74736e4a24b1c909b41a541ad8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab"
I20260811 07:32:53.065932 1281 raft_consensus.cc:3037] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:53.067008 1073 raft_consensus.cc:2454] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e539fe74736e4a24b1c909b41a541ad8 in term 1.
I20260811 07:32:53.067444 796 leader_election.cc:302] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e309c25814f34556a490a282165bedf7, e539fe74736e4a24b1c909b41a541ad8; no voters:
I20260811 07:32:53.067777 1398 raft_consensus.cc:2781] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:53.067832 1281 raft_consensus.cc:2454] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e539fe74736e4a24b1c909b41a541ad8 in term 1.
I20260811 07:32:53.068166 1398 raft_consensus.cc:686] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 1 LEADER]: Becoming Leader. State: Replica: e539fe74736e4a24b1c909b41a541ad8, State: Running, Role: LEADER
I20260811 07:32:53.068750 1398 consensus_queue.cc:237] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:53.073783 32035 catalog_manager.cc:5495] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e539fe74736e4a24b1c909b41a541ad8 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "e539fe74736e4a24b1c909b41a541ad8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:53.124267 1383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.118960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55736 (local address 127.22.4.193:43063)
0811 07:32:53.119149 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:53.119153 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:53.119172 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:32:53.119301 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:53.119304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:53.119385 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:53.119525 (+ 140us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:53.119858 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.120525 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.121611 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.121882 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.121992 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.122471 (+ 479us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:53.123418 (+ 947us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:53.123605 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:53.123854 (+ 249us) server_negotiation.cc:299] Negotiation successful
0811 07:32:53.123983 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:32:53.133236 1073 raft_consensus.cc:1261] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 1 FOLLOWER]: Refusing update from remote peer e539fe74736e4a24b1c909b41a541ad8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:53.133347 1281 raft_consensus.cc:1261] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 1 FOLLOWER]: Refusing update from remote peer e539fe74736e4a24b1c909b41a541ad8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:53.134363 1398 consensus_queue.cc:1035] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:53.134765 1401 consensus_queue.cc:1035] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:53.145438 1405 mvcc.cc:205] Tried to move back new op lower bound from 7317231915543298048 to 7317231915293908992. Current Snapshot: MvccSnapshot[applied={T|T < 7317231915543298048}]
I20260811 07:32:53.159883 32035 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:53.160135 32035 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36144:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:53.166097 32035 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a7778e725044486791c7184c9a23634a: Sending DeleteTablet for 3 replicas of tablet bd929b47afa44a10a8993be99878744d
I20260811 07:32:53.168109 857 tablet_service.cc:1514] Processing DeleteTablet for tablet bd929b47afa44a10a8993be99878744d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:53 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:55732
I20260811 07:32:53.168186 1043 tablet_service.cc:1514] Processing DeleteTablet for tablet bd929b47afa44a10a8993be99878744d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:53 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:40354
I20260811 07:32:53.168991 1419 tablet_replica.cc:330] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: stopping tablet replica
I20260811 07:32:53.168946 1250 tablet_service.cc:1514] Processing DeleteTablet for tablet bd929b47afa44a10a8993be99878744d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:53 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:37560
I20260811 07:32:53.169482 1425 tablet_replica.cc:330] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: stopping tablet replica
I20260811 07:32:53.169513 1419 raft_consensus.cc:2229] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:53.169781 1425 raft_consensus.cc:2229] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:53.170008 1419 raft_consensus.cc:2258] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:53.170035 1425 raft_consensus.cc:2258] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:53.171777 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 31996
I20260811 07:32:53.181591 1425 ts_tablet_manager.cc:1905] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:53.181951 1419 ts_tablet_manager.cc:1905] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:53.185277 1425 ts_tablet_manager.cc:1918] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:53.185276 1419 ts_tablet_manager.cc:1918] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:53.185408 1425 log.cc:1196] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/bd929b47afa44a10a8993be99878744d
I20260811 07:32:53.185408 1419 log.cc:1196] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/bd929b47afa44a10a8993be99878744d
I20260811 07:32:53.185817 1425 ts_tablet_manager.cc:1939] T bd929b47afa44a10a8993be99878744d P bca089e6298e48a0a1d4fd8e13ad1fab: Deleting consensus metadata
I20260811 07:32:53.185817 1419 ts_tablet_manager.cc:1939] T bd929b47afa44a10a8993be99878744d P e309c25814f34556a490a282165bedf7: Deleting consensus metadata
I20260811 07:32:53.188201 1420 tablet_replica.cc:330] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: stopping tablet replica
I20260811 07:32:53.188755 1420 raft_consensus.cc:2229] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:53.189352 1420 raft_consensus.cc:2258] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:53.191840 1420 ts_tablet_manager.cc:1905] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:32:53.192780 1179 connection.cc:535] server connection from 127.0.0.1:37560 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 07:32:53.193665 985 connection.cc:535] server connection from 127.0.0.1:40354 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:32:53.197671 1360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.169808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54814 (local address 127.22.4.253:37381)
0811 07:32:53.170060 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:53.170065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:53.186096 (+ 16031us) server_negotiation.cc:407] Connection header received
0811 07:32:53.186359 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:53.186365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:53.186442 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:53.186507 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:53.187956 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.188846 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.190259 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.190639 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.190733 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.193397 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:53.193401 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:53.193405 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:53.193441 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:53.195466 (+ 2025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:53.196059 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:53.196064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:53.196065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:53.196163 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:53.196494 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:53.196498 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:53.196500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:53.196757 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:53.196875 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:53.197268 (+ 393us) server_negotiation.cc:299] Negotiation successful
0811 07:32:53.197439 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260811 07:32:53.208397 1420 ts_tablet_manager.cc:1918] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:53.208595 1420 log.cc:1196] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/bd929b47afa44a10a8993be99878744d
I20260811 07:32:53.209075 1420 ts_tablet_manager.cc:1939] T bd929b47afa44a10a8993be99878744d P e539fe74736e4a24b1c909b41a541ad8: Deleting consensus metadata
I20260811 07:32:53.209947 952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.169922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32986 (local address 127.22.4.252:39539)
0811 07:32:53.170058 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:53.170085 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:53.199736 (+ 29651us) server_negotiation.cc:407] Connection header received
0811 07:32:53.199949 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:53.199953 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:53.200022 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:53.200087 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:53.201078 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.201944 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.203083 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.203386 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.203464 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.205424 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:53.205429 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:53.205432 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:53.205462 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:53.207455 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:53.208001 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:53.208008 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:53.208013 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:53.208400 (+ 387us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:53.208767 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:53.208772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:53.208773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:53.209075 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:53.209198 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:53.209613 (+ 415us) server_negotiation.cc:299] Negotiation successful
0811 07:32:53.209772 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260811 07:32:53.210875 797 connection.cc:441] server connection from 127.0.0.1:55732 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55732 (request call id 1) could send its response
I20260811 07:32:53.213768 1153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.199394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32988 (local address 127.22.4.252:39539)
0811 07:32:53.199558 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:53.199563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:53.203515 (+ 3952us) server_negotiation.cc:407] Connection header received
0811 07:32:53.203747 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:53.203751 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:53.203811 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:53.203868 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:53.204971 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.205824 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.207162 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.207516 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.207593 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.209752 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:53.209757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:53.209760 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:53.209789 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:53.211615 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:53.212235 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:53.212242 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:53.212246 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:53.212351 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:53.212671 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:53.212675 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:53.212677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:53.212912 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:53.213025 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:53.213424 (+ 399us) server_negotiation.cc:299] Negotiation successful
0811 07:32:53.213584 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:32:53.223191 1360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:53.200102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54830 (local address 127.22.4.253:37381)
0811 07:32:53.200233 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:53.200237 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:53.212397 (+ 12160us) server_negotiation.cc:407] Connection header received
0811 07:32:53.212711 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:53.212715 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:53.212783 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:53.212838 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:53.213776 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.214669 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.215903 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:53.216277 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:53.216352 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:53.218599 (+ 2247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:53.218604 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:53.218607 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:53.218645 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:53.220844 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:53.221560 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:53.221564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:53.221567 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:53.221691 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:53.222029 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:53.222032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:53.222034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:53.222292 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:53.222455 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:53.222759 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 07:32:53.222983 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:32:54.152920 1435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.152197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:36793)
0811 07:32:54.152632 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.152773 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":105,"threads_started":1}
W20260811 07:32:54.153528 1346 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:40787 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:54.155485 1436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.154775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:54237)
0811 07:32:54.155184 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.155332 (+ 148us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":157,"threads_started":1}
W20260811 07:32:54.155850 1137 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:40787 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:54.160667 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.159932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:35119)
0811 07:32:54.160277 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.160429 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":85,"threads_started":1}
W20260811 07:32:54.161092 949 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:40787 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:54.667429 1439 raft_consensus.cc:482] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7778e725044486791c7184c9a23634a)
I20260811 07:32:54.667429 1440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a7778e725044486791c7184c9a23634a)
I20260811 07:32:54.667639 1439 raft_consensus.cc:504] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } }
I20260811 07:32:54.667970 1440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } }
I20260811 07:32:54.668526 1439 leader_election.cc:288] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7778e725044486791c7184c9a23634a (127.22.4.254:40787), 66a565e07dc741b7a4c4f557d603d2de (127.22.4.253:37381)
I20260811 07:32:54.669524 1440 leader_election.cc:288] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a7778e725044486791c7184c9a23634a (127.22.4.254:40787), afe45d53d5954086a4921e48450e9425 (127.22.4.252:39539)
I20260811 07:32:54.670228 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.668874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36638)
0811 07:32:54.669337 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.669481 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":108,"threads_started":1}
I20260811 07:32:54.670346 1447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.669715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36654)
0811 07:32:54.670104 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.670197 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":102,"threads_started":1}
W20260811 07:32:54.670523 685 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
W20260811 07:32:54.670555 410 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:54.671840 1447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.671539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36672)
0811 07:32:54.671691 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.671751 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 07:32:54.671916 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.671543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36670)
0811 07:32:54.671759 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.671826 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
W20260811 07:32:54.671970 410 leader_election.cc:334] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a7778e725044486791c7184c9a23634a (127.22.4.254:40787): Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
W20260811 07:32:54.672053 685 leader_election.cc:334] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a7778e725044486791c7184c9a23634a (127.22.4.254:40787): Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:54.675472 1448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.669813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:39539 (local address 127.0.0.1:32994)
0811 07:32:54.670580 (+ 767us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.670598 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:54.670763 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:54.671451 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:54.671457 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:54.671483 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:54.671686 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:54.671697 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:54.672868 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:54.672875 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:54.673892 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:54.673905 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:54.674967 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:54.674971 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:54.675086 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:54.675132 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:32:54.675232 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 07:32:54.675339 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":88,"threads_started":1}
I20260811 07:32:54.675832 1444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.669547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54844 (local address 127.22.4.253:37381)
0811 07:32:54.670797 (+ 1250us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:54.670804 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:54.670974 (+ 170us) server_negotiation.cc:407] Connection header received
0811 07:32:54.671041 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:54.671046 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:54.671103 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:54.671641 (+ 538us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:54.671768 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:54.672750 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:54.674357 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:54.675090 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:54.675213 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:54.675277 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:54.675594 (+ 317us) server_negotiation.cc:299] Negotiation successful
0811 07:32:54.675704 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1072,"thread_start_us":244,"threads_started":1}
I20260811 07:32:54.675877 1449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.670285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32994 (local address 127.22.4.252:39539)
0811 07:32:54.671155 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:54.671160 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:54.671175 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:32:54.671238 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:54.671242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:54.671292 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:54.671813 (+ 521us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:54.671980 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:54.672724 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:54.674052 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:54.674736 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:54.674955 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:54.675038 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:54.675280 (+ 242us) server_negotiation.cc:299] Negotiation successful
0811 07:32:54.675379 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":797,"thread_start_us":104,"threads_started":1}
I20260811 07:32:54.675908 1442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.669329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:37381 (local address 127.0.0.1:54844)
0811 07:32:54.669995 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.670015 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:54.670159 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:54.671332 (+ 1173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:54.671336 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:54.671360 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:54.671518 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:54.671527 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:54.672913 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:54.672915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:54.674182 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:54.674193 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:54.675294 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:54.675297 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:54.675405 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:54.675428 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:32:54.675560 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 07:32:54.675735 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":96,"threads_started":1}
I20260811 07:32:54.676483 715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "66a565e07dc741b7a4c4f557d603d2de" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "afe45d53d5954086a4921e48450e9425" is_pre_election: true
I20260811 07:32:54.676651 449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "afe45d53d5954086a4921e48450e9425" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "66a565e07dc741b7a4c4f557d603d2de" is_pre_election: true
I20260811 07:32:54.676760 715 raft_consensus.cc:2454] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a565e07dc741b7a4c4f557d603d2de in term 1.
I20260811 07:32:54.676810 449 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afe45d53d5954086a4921e48450e9425 in term 1.
I20260811 07:32:54.677165 685 leader_election.cc:302] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a565e07dc741b7a4c4f557d603d2de, afe45d53d5954086a4921e48450e9425; no voters: a7778e725044486791c7184c9a23634a
I20260811 07:32:54.677205 409 leader_election.cc:302] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a565e07dc741b7a4c4f557d603d2de, afe45d53d5954086a4921e48450e9425; no voters: a7778e725044486791c7184c9a23634a
I20260811 07:32:54.677397 1439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 07:32:54.677439 1440 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 07:32:54.677492 1439 raft_consensus.cc:482] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7778e725044486791c7184c9a23634a)
I20260811 07:32:54.677500 1440 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Starting leader election (detected failure of leader a7778e725044486791c7184c9a23634a)
I20260811 07:32:54.677544 1440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:32:54.677544 1439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:32:54.679467 1440 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } }
I20260811 07:32:54.679468 1439 raft_consensus.cc:504] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } }
I20260811 07:32:54.680038 1439 leader_election.cc:288] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [CANDIDATE]: Term 2 election: Requested vote from peers a7778e725044486791c7184c9a23634a (127.22.4.254:40787), 66a565e07dc741b7a4c4f557d603d2de (127.22.4.253:37381)
I20260811 07:32:54.680055 1440 leader_election.cc:288] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 2 election: Requested vote from peers a7778e725044486791c7184c9a23634a (127.22.4.254:40787), afe45d53d5954086a4921e48450e9425 (127.22.4.252:39539)
I20260811 07:32:54.680704 1442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.680328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36716)
0811 07:32:54.680506 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.680586 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 07:32:54.681006 449 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "afe45d53d5954086a4921e48450e9425" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "66a565e07dc741b7a4c4f557d603d2de"
I20260811 07:32:54.681092 715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "66a565e07dc741b7a4c4f557d603d2de" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "afe45d53d5954086a4921e48450e9425"
I20260811 07:32:54.681252 1448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.680327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36704)
0811 07:32:54.681106 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.681174 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":691}
I20260811 07:32:54.681280 715 raft_consensus.cc:2379] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66a565e07dc741b7a4c4f557d603d2de in current term 2: Already voted for candidate afe45d53d5954086a4921e48450e9425 in this term.
I20260811 07:32:54.681269 449 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate afe45d53d5954086a4921e48450e9425 in current term 2: Already voted for candidate 66a565e07dc741b7a4c4f557d603d2de in this term.
I20260811 07:32:54.681995 1442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.681781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36722)
0811 07:32:54.681891 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.681941 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 07:32:54.682272 685 leader_election.cc:334] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a7778e725044486791c7184c9a23634a (127.22.4.254:40787): Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:54.682395 685 leader_election.cc:302] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: afe45d53d5954086a4921e48450e9425; no voters: 66a565e07dc741b7a4c4f557d603d2de, a7778e725044486791c7184c9a23634a
I20260811 07:32:54.682585 1439 raft_consensus.cc:2726] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 07:32:54.683403 1448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:54.683141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36728)
0811 07:32:54.683282 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:54.683336 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260811 07:32:54.683522 410 leader_election.cc:334] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a7778e725044486791c7184c9a23634a (127.22.4.254:40787): Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:54.683677 410 leader_election.cc:302] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66a565e07dc741b7a4c4f557d603d2de; no voters: a7778e725044486791c7184c9a23634a, afe45d53d5954086a4921e48450e9425
I20260811 07:32:54.683848 1440 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 07:32:55.155170 1453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:55.154466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:39043)
0811 07:32:55.154926 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:55.155040 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":188,"threads_started":1}
I20260811 07:32:55.157068 1455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:55.156500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:55165)
0811 07:32:55.156851 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:55.156917 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":134,"threads_started":1}
I20260811 07:32:55.162230 1456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:55.161782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:58229)
0811 07:32:55.162068 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:55.162130 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":115,"threads_started":1}
I20260811 07:32:56.157487 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.156545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:54849)
0811 07:32:56.157210 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.157303 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":186,"threads_started":1}
I20260811 07:32:56.158689 1458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.158084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:50905)
0811 07:32:56.158485 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.158583 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":121,"threads_started":1}
I20260811 07:32:56.163848 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.163274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:49239)
0811 07:32:56.163628 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.163718 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":92,"threads_started":1}
I20260811 07:32:56.194353 1460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:56.194691 1460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } }
I20260811 07:32:56.195500 1460 leader_election.cc:288] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a7778e725044486791c7184c9a23634a (127.22.4.254:40787), afe45d53d5954086a4921e48450e9425 (127.22.4.252:39539)
I20260811 07:32:56.196449 715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "66a565e07dc741b7a4c4f557d603d2de" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "afe45d53d5954086a4921e48450e9425" is_pre_election: true
I20260811 07:32:56.196524 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.195775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36906)
0811 07:32:56.196258 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.196408 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":130,"threads_started":1}
I20260811 07:32:56.196707 715 raft_consensus.cc:2454] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66a565e07dc741b7a4c4f557d603d2de in term 2.
I20260811 07:32:56.197213 409 leader_election.cc:302] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66a565e07dc741b7a4c4f557d603d2de, afe45d53d5954086a4921e48450e9425; no voters:
I20260811 07:32:56.197502 1460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 07:32:56.197597 1460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:56.197698 1460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:32:56.197834 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.197572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36914)
0811 07:32:56.197722 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.197769 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
W20260811 07:32:56.197958 410 leader_election.cc:334] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a7778e725044486791c7184c9a23634a (127.22.4.254:40787): Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:56.199371 1460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } }
I20260811 07:32:56.199904 1460 leader_election.cc:288] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 3 election: Requested vote from peers a7778e725044486791c7184c9a23634a (127.22.4.254:40787), afe45d53d5954086a4921e48450e9425 (127.22.4.252:39539)
I20260811 07:32:56.200614 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.200169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36926)
0811 07:32:56.200429 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.200513 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260811 07:32:56.200614 715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "66a565e07dc741b7a4c4f557d603d2de" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "afe45d53d5954086a4921e48450e9425"
I20260811 07:32:56.200784 715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:32:56.201459 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.201224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36940)
0811 07:32:56.201350 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.201405 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:32:56.201634 410 leader_election.cc:334] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a7778e725044486791c7184c9a23634a (127.22.4.254:40787): Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
I20260811 07:32:56.202291 715 raft_consensus.cc:2454] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66a565e07dc741b7a4c4f557d603d2de in term 3.
I20260811 07:32:56.202726 409 leader_election.cc:302] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66a565e07dc741b7a4c4f557d603d2de, afe45d53d5954086a4921e48450e9425; no voters: a7778e725044486791c7184c9a23634a
I20260811 07:32:56.203115 1460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:32:56.203512 1460 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [term 3 LEADER]: Becoming Leader. State: Replica: 66a565e07dc741b7a4c4f557d603d2de, State: Running, Role: LEADER
I20260811 07:32:56.203876 1460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } }
I20260811 07:32:56.205441 1463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66a565e07dc741b7a4c4f557d603d2de. Latest consensus state: current_term: 3 leader_uuid: "66a565e07dc741b7a4c4f557d603d2de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:56.205614 1463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:56.206197 1466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:56.209975 1466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:56.210781 1466 catalog_manager.cc:1259] Loaded cluster ID: 6319e98b920a4054bf79fdb59650bf46
I20260811 07:32:56.211342 1466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:56.212450 1466 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:56.212966 1466 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Loaded TSK: 0
I20260811 07:32:56.213817 1466 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:32:56.270694 429 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54830:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:56.276091 429 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:56.281111 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.280641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36950)
0811 07:32:56.280845 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.280972 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 07:32:56.281315 715 raft_consensus.cc:1261] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [term 3 FOLLOWER]: Refusing update from remote peer 66a565e07dc741b7a4c4f557d603d2de: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 07:32:56.282088 1463 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [LEADER]: Connected to new peer: Peer: permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 07:32:56.282234 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.281934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.0.0.1:36956)
0811 07:32:56.282077 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.282154 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:32:56.282455 410 consensus_peers.cc:487] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de -> Peer a7778e725044486791c7184c9a23634a (127.22.4.254:40787): Couldn't send request to peer a7778e725044486791c7184c9a23634a. Status: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 07:32:56.284417 1469 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66a565e07dc741b7a4c4f557d603d2de. Latest consensus state: current_term: 3 leader_uuid: "66a565e07dc741b7a4c4f557d603d2de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:56.284633 1469 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:56.286684 1460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "66a565e07dc741b7a4c4f557d603d2de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:56.286917 1460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:56.287330 1472 mvcc.cc:205] Tried to move back new op lower bound from 7317231928440098816 to 7317231928134156288. Current Snapshot: MvccSnapshot[applied={T|T < 7317231928440098816}]
I20260811 07:32:56.287494 1469 sys_catalog.cc:455] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "66a565e07dc741b7a4c4f557d603d2de" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "a7778e725044486791c7184c9a23634a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40787 } } peers { permanent_uuid: "66a565e07dc741b7a4c4f557d603d2de" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 37381 } attrs { promote: false } } peers { permanent_uuid: "afe45d53d5954086a4921e48450e9425" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 39539 } attrs { promote: false } } }
I20260811 07:32:56.287650 1469 sys_catalog.cc:458] T 00000000000000000000000000000000 P afe45d53d5954086a4921e48450e9425 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:32:56.303287 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.296986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:43063 (local address 127.0.0.1:55746)
0811 07:32:56.297393 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.297423 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:56.297575 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:56.298578 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:56.298582 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:56.298603 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:56.298772 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.298784 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.300121 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.300125 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.301286 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.301298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.302770 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.302774 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.302913 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.302949 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:32:56.303028 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 07:32:56.303128 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":90}
I20260811 07:32:56.303591 1479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.297721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:44567 (local address 127.0.0.1:37568)
0811 07:32:56.298784 (+ 1063us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.298798 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:56.298952 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:56.299293 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:56.299297 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:56.299314 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:56.299453 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.299459 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.300317 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.300320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.301286 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.301298 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.302969 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.302975 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.303080 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.303124 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 07:32:56.303213 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:32:56.303340 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":978,"mutex_wait_us":3,"thread_start_us":107,"threads_started":1}
I20260811 07:32:56.304023 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.297251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:34103 (local address 127.0.0.1:40368)
0811 07:32:56.297976 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.297991 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:56.298148 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:56.298809 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:56.298815 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:56.298866 (+ 51us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:56.298979 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.298985 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.301173 (+ 2188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.301177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.302154 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.302164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.303533 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.303537 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.303641 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.303662 (+ 21us) client_negotiation.cc:769] Sending connection context
0811 07:32:56.303779 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 07:32:56.303879 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":208,"threads_started":1}
I20260811 07:32:56.304096 1481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.298143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40368 (local address 127.22.4.194:34103)
0811 07:32:56.298534 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:56.298541 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:56.298557 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:32:56.298620 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:56.298622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:56.298675 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:56.299102 (+ 427us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:56.299213 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.299970 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.302318 (+ 2348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.302936 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.303052 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.303121 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:56.303858 (+ 737us) server_negotiation.cc:299] Negotiation successful
0811 07:32:56.303954 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":134,"threads_started":1}
I20260811 07:32:56.304332 1482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.298433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37568 (local address 127.22.4.195:44567)
0811 07:32:56.299051 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:56.299056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:56.299077 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:32:56.299125 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:56.299127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:56.299169 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:56.299274 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:56.299568 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.300185 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.301658 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.302582 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.302724 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.302868 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:56.303990 (+ 1122us) server_negotiation.cc:299] Negotiation successful
0811 07:32:56.304129 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":529,"thread_start_us":97,"threads_started":1}
I20260811 07:32:56.305148 1043 tablet_service.cc:1467] Processing CreateTablet for tablet 20e5124ae0554b0e9913447d87de216b (DEFAULT_TABLE table=test-table [id=9a90f66529ad47f59f64c798d012b26c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:56.305188 1250 tablet_service.cc:1467] Processing CreateTablet for tablet 20e5124ae0554b0e9913447d87de216b (DEFAULT_TABLE table=test-table [id=9a90f66529ad47f59f64c798d012b26c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:56.305613 1250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20e5124ae0554b0e9913447d87de216b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:56.305653 1043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20e5124ae0554b0e9913447d87de216b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:56.307211 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.297797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55746 (local address 127.22.4.193:43063)
0811 07:32:56.298213 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:56.298220 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:56.298238 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:32:56.298349 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:56.298352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:56.298415 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:56.298943 (+ 528us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:56.299080 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.299984 (+ 904us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.301656 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.302528 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.302771 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.302883 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:56.304478 (+ 1595us) server_negotiation.cc:299] Negotiation successful
0811 07:32:56.307008 (+ 2530us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":179,"threads_started":1}
I20260811 07:32:56.308939 1483 tablet_bootstrap.cc:492] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: Bootstrap starting.
I20260811 07:32:56.309259 857 tablet_service.cc:1467] Processing CreateTablet for tablet 20e5124ae0554b0e9913447d87de216b (DEFAULT_TABLE table=test-table [id=9a90f66529ad47f59f64c798d012b26c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:56.309670 857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 20e5124ae0554b0e9913447d87de216b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:56.310276 1484 tablet_bootstrap.cc:492] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: Bootstrap starting.
I20260811 07:32:56.311066 1483 tablet_bootstrap.cc:654] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:56.311951 1484 tablet_bootstrap.cc:654] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:56.312594 1486 tablet_bootstrap.cc:492] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8: Bootstrap starting.
I20260811 07:32:56.313385 1483 tablet_bootstrap.cc:492] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: No bootstrap required, opened a new log
I20260811 07:32:56.313529 1483 ts_tablet_manager.cc:1397] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260811 07:32:56.313601 1484 tablet_bootstrap.cc:492] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: No bootstrap required, opened a new log
I20260811 07:32:56.313858 1484 ts_tablet_manager.cc:1397] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:56.314399 1486 tablet_bootstrap.cc:654] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:56.314383 1483 raft_consensus.cc:348] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.314455 1484 raft_consensus.cc:348] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.314551 1483 raft_consensus.cc:374] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:56.314576 1484 raft_consensus.cc:374] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:56.314596 1483 raft_consensus.cc:729] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bca089e6298e48a0a1d4fd8e13ad1fab, State: Initialized, Role: FOLLOWER
I20260811 07:32:56.314618 1484 raft_consensus.cc:729] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e309c25814f34556a490a282165bedf7, State: Initialized, Role: FOLLOWER
I20260811 07:32:56.314785 1483 consensus_queue.cc:260] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.315367 1483 ts_tablet_manager.cc:1428] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260811 07:32:56.315454 1484 consensus_queue.cc:260] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.315980 1484 ts_tablet_manager.cc:1428] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:32:56.317152 1458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.316594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:48199)
0811 07:32:56.316956 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.317037 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253}
I20260811 07:32:56.317202 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.316799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:40533)
0811 07:32:56.317055 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.317108 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178}
I20260811 07:32:56.320533 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.320119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:34691)
0811 07:32:56.320336 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.320406 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124}
I20260811 07:32:56.321055 1139 heartbeater.cc:503] Master 127.22.4.253:37381 was elected leader, sending a full tablet report...
I20260811 07:32:56.321288 1347 heartbeater.cc:503] Master 127.22.4.253:37381 was elected leader, sending a full tablet report...
I20260811 07:32:56.321310 1486 tablet_bootstrap.cc:492] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8: No bootstrap required, opened a new log
I20260811 07:32:56.321451 1486 ts_tablet_manager.cc:1397] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260811 07:32:56.322111 1486 raft_consensus.cc:348] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.322376 1486 raft_consensus.cc:374] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:56.322453 1486 raft_consensus.cc:729] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e539fe74736e4a24b1c909b41a541ad8, State: Initialized, Role: FOLLOWER
I20260811 07:32:56.322687 1486 consensus_queue.cc:260] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.323366 1486 ts_tablet_manager.cc:1428] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:32:56.324725 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.324199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:53667)
0811 07:32:56.324518 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.324579 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230}
I20260811 07:32:56.326784 950 heartbeater.cc:503] Master 127.22.4.253:37381 was elected leader, sending a full tablet report...
I20260811 07:32:56.327023 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.326445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:38287)
0811 07:32:56.326703 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.326802 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260811 07:32:56.362955 1492 raft_consensus.cc:482] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:56.363240 1492 raft_consensus.cc:504] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.365121 1492 leader_election.cc:288] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e539fe74736e4a24b1c909b41a541ad8 (127.22.4.193:43063), bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567)
I20260811 07:32:56.370671 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.365656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:43353 (local address 127.22.4.193:43063)
0811 07:32:56.365815 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:56.365819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:56.365837 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:32:56.366043 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:56.366047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:56.366112 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:56.366222 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:56.367078 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.367753 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.369443 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.369926 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.370101 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.370174 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:56.370381 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 07:32:56.370482 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:32:56.370703 1458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.365470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:43063 (local address 127.22.4.194:43353)
0811 07:32:56.365653 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.365676 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:56.365864 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:56.366395 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:56.366398 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:56.366417 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:56.366554 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.366559 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.368009 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.368013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.369293 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.369303 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.370111 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.370115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.370228 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.370255 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:32:56.370361 (+ 106us) client_negotiation.cc:240] Negotiation successful
0811 07:32:56.370461 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 07:32:56.370883 1482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.366143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:56101 (local address 127.22.4.195:44567)
0811 07:32:56.366320 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:56.366325 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:56.366529 (+ 204us) server_negotiation.cc:407] Connection header received
0811 07:32:56.366668 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:56.366671 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:56.366729 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:56.366815 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:56.367195 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.367900 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.369545 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.370006 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.370173 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.370243 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:56.370543 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 07:32:56.370646 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:32:56.371114 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.365960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:44567 (local address 127.22.4.194:56101)
0811 07:32:56.366417 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.366429 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:56.366566 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:56.366875 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:56.366878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:56.366897 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:56.367026 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.367032 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.368087 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.368092 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.369361 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:56.369377 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.370173 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.370177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:56.370315 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.370373 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 07:32:56.370521 (+ 148us) client_negotiation.cc:240] Negotiation successful
0811 07:32:56.370646 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":3,"thread_start_us":230,"threads_started":1}
I20260811 07:32:56.371770 1281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20e5124ae0554b0e9913447d87de216b" candidate_uuid: "e309c25814f34556a490a282165bedf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" is_pre_election: true
I20260811 07:32:56.371858 885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20e5124ae0554b0e9913447d87de216b" candidate_uuid: "e309c25814f34556a490a282165bedf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e539fe74736e4a24b1c909b41a541ad8" is_pre_election: true
I20260811 07:32:56.372043 1281 raft_consensus.cc:2454] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e309c25814f34556a490a282165bedf7 in term 0.
I20260811 07:32:56.372200 885 raft_consensus.cc:2454] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e309c25814f34556a490a282165bedf7 in term 0.
I20260811 07:32:56.372641 984 leader_election.cc:302] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bca089e6298e48a0a1d4fd8e13ad1fab, e309c25814f34556a490a282165bedf7; no voters:
I20260811 07:32:56.373119 1492 raft_consensus.cc:2781] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:56.373234 1492 raft_consensus.cc:482] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:56.373287 1492 raft_consensus.cc:3037] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:56.374596 1492 raft_consensus.cc:504] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.375131 1492 leader_election.cc:288] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [CANDIDATE]: Term 1 election: Requested vote from peers e539fe74736e4a24b1c909b41a541ad8 (127.22.4.193:43063), bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567)
I20260811 07:32:56.376001 1281 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20e5124ae0554b0e9913447d87de216b" candidate_uuid: "e309c25814f34556a490a282165bedf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab"
I20260811 07:32:56.376230 1281 raft_consensus.cc:3037] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:56.377501 885 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "20e5124ae0554b0e9913447d87de216b" candidate_uuid: "e309c25814f34556a490a282165bedf7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e539fe74736e4a24b1c909b41a541ad8"
I20260811 07:32:56.377671 1281 raft_consensus.cc:2454] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e309c25814f34556a490a282165bedf7 in term 1.
I20260811 07:32:56.377707 885 raft_consensus.cc:3037] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:56.378142 984 leader_election.cc:302] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bca089e6298e48a0a1d4fd8e13ad1fab, e309c25814f34556a490a282165bedf7; no voters:
I20260811 07:32:56.378482 1492 raft_consensus.cc:2781] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:56.378871 1492 raft_consensus.cc:686] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 1 LEADER]: Becoming Leader. State: Replica: e309c25814f34556a490a282165bedf7, State: Running, Role: LEADER
I20260811 07:32:56.379207 1492 consensus_queue.cc:237] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } }
I20260811 07:32:56.379684 885 raft_consensus.cc:2454] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e309c25814f34556a490a282165bedf7 in term 1.
I20260811 07:32:56.380422 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.379870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:34337)
0811 07:32:56.380140 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.380201 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260811 07:32:56.382812 434 catalog_manager.cc:5495] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e309c25814f34556a490a282165bedf7 (127.22.4.194). New cstate: current_term: 1 leader_uuid: "e309c25814f34556a490a282165bedf7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e309c25814f34556a490a282165bedf7" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 34103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:56.419625 1481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.414309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40374 (local address 127.22.4.194:34103)
0811 07:32:56.414581 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:56.414587 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:56.414718 (+ 131us) server_negotiation.cc:407] Connection header received
0811 07:32:56.415153 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:56.415189 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:56.415304 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:56.415496 (+ 192us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:56.415838 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.416463 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.417480 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:56.417829 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:56.417958 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:56.418315 (+ 357us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:56.419107 (+ 792us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:56.419260 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:56.419332 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 07:32:56.419409 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 07:32:56.423892 1281 raft_consensus.cc:1261] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 1 FOLLOWER]: Refusing update from remote peer e309c25814f34556a490a282165bedf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:56.424425 885 raft_consensus.cc:1261] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8 [term 1 FOLLOWER]: Refusing update from remote peer e309c25814f34556a490a282165bedf7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:56.424876 1495 consensus_queue.cc:1035] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bca089e6298e48a0a1d4fd8e13ad1fab" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 44567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:56.425232 1492 consensus_queue.cc:1035] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e539fe74736e4a24b1c909b41a541ad8" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 43063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:56.427846 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.427519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:53383)
0811 07:32:56.427687 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.427752 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260811 07:32:56.428045 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.427659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:55211)
0811 07:32:56.427864 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.427924 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260811 07:32:56.432286 1499 mvcc.cc:205] Tried to move back new op lower bound from 7317231929024323584 to 7317231928853696512. Current Snapshot: MvccSnapshot[applied={T|T < 7317231929024323584}]
I20260811 07:32:56.433241 1500 mvcc.cc:205] Tried to move back new op lower bound from 7317231929024323584 to 7317231928853696512. Current Snapshot: MvccSnapshot[applied={T|T < 7317231929024323584}]
I20260811 07:32:56.433697 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.433319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:58113)
0811 07:32:56.433503 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.433577 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260811 07:32:56.434470 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.434111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.195:37393)
0811 07:32:56.434298 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.434376 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 07:32:56.435981 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.435203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.194:45449)
0811 07:32:56.435823 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.435900 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":530}
I20260811 07:32:56.436300 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.435953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40787 (local address 127.22.4.193:51287)
0811 07:32:56.436145 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.436205 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:40787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260811 07:32:56.445842 429 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:56.446077 429 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54830:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:56.452260 429 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 66a565e07dc741b7a4c4f557d603d2de: Sending DeleteTablet for 3 replicas of tablet 20e5124ae0554b0e9913447d87de216b
I20260811 07:32:56.453320 1043 tablet_service.cc:1514] Processing DeleteTablet for tablet 20e5124ae0554b0e9913447d87de216b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:56 UTC) from {username='oryx', principal='oryx/127.22.4.253@KRBTEST.COM'} at 127.0.0.1:40368
I20260811 07:32:56.453532 857 tablet_service.cc:1514] Processing DeleteTablet for tablet 20e5124ae0554b0e9913447d87de216b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:56 UTC) from {username='oryx', principal='oryx/127.22.4.253@KRBTEST.COM'} at 127.0.0.1:55746
I20260811 07:32:56.453830 1514 tablet_replica.cc:330] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: stopping tablet replica
I20260811 07:32:56.453967 1514 raft_consensus.cc:2229] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:56.454334 1514 raft_consensus.cc:2258] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:56.455360 1514 ts_tablet_manager.cc:1905] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:56.456301 1516 tablet_replica.cc:330] T 20e5124ae0554b0e9913447d87de216b P e539fe74736e4a24b1c909b41a541ad8: stopping tablet replica
I20260811 07:32:56.456459 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 645
I20260811 07:32:56.463743 1250 tablet_service.cc:1514] Processing DeleteTablet for tablet 20e5124ae0554b0e9913447d87de216b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:56 UTC) from {username='oryx', principal='oryx/127.22.4.253@KRBTEST.COM'} at 127.0.0.1:37568
I20260811 07:32:56.464461 1517 tablet_replica.cc:330] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: stopping tablet replica
I20260811 07:32:56.464522 1514 ts_tablet_manager.cc:1918] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:56.464656 1514 log.cc:1196] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/20e5124ae0554b0e9913447d87de216b
I20260811 07:32:56.464775 1517 raft_consensus.cc:2229] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:56.465019 1517 raft_consensus.cc:2258] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:56.465050 1514 ts_tablet_manager.cc:1939] T 20e5124ae0554b0e9913447d87de216b P e309c25814f34556a490a282165bedf7: Deleting consensus metadata
I20260811 07:32:56.466871 409 catalog_manager.cc:4841] TS e309c25814f34556a490a282165bedf7 (127.22.4.194:34103): tablet 20e5124ae0554b0e9913447d87de216b (table test-table [id=9a90f66529ad47f59f64c798d012b26c]) successfully deleted
I20260811 07:32:56.467552 1517 ts_tablet_manager.cc:1905] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:56.472147 1517 ts_tablet_manager.cc:1918] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:56.472325 1517 log.cc:1196] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/20e5124ae0554b0e9913447d87de216b
I20260811 07:32:56.473107 1517 ts_tablet_manager.cc:1939] T 20e5124ae0554b0e9913447d87de216b P bca089e6298e48a0a1d4fd8e13ad1fab: Deleting consensus metadata
I20260811 07:32:56.474481 409 catalog_manager.cc:4841] TS bca089e6298e48a0a1d4fd8e13ad1fab (127.22.4.195:44567): tablet 20e5124ae0554b0e9913447d87de216b (table test-table [id=9a90f66529ad47f59f64c798d012b26c]) successfully deleted
I20260811 07:32:56.476878 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 962
I20260811 07:32:56.477250 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:56.476618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:43063 (local address 127.0.0.1:55754)
0811 07:32:56.476962 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:56.477111 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:43063: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 07:32:56.492218 409 catalog_manager.cc:4584] TS e539fe74736e4a24b1c909b41a541ad8 (127.22.4.193:43063): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 20e5124ae0554b0e9913447d87de216b: Network error: Client connection negotiation failed: client connection to 127.22.4.193:43063: connect: Connection refused (error 111)
I20260811 07:32:56.502048 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 1154
I20260811 07:32:56.523661 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 32702
I20260811 07:32:56.560092 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 381
2026-08-11T07:32:56Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (8470 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:32:56 dist-test-slave-7z32 krb5kdc[1526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:32:56 dist-test-slave-7z32 krb5kdc[1526](info): set up 2 sockets
Aug 11 07:32:56 dist-test-slave-7z32 krb5kdc[1526](info): commencing operation
krb5kdc: starting...
W20260811 07:32:57.939932 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.335s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:32:58 dist-test-slave-7z32 krb5kdc[1526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:32:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:32:58Z Disabled control of system clock
WARNING: no policy specified for oryx/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.254.keytab.
Entry for principal oryx/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.254.keytab.
I20260811 07:32:58.125411 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:40285
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.254.keytab
--principal=oryx/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:40285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:58.289923 1545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:58.290383 1545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:58.290436 1545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:58.295444 1545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:32:58.295593 1545 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 07:32:58.295614 1545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:58.295634 1545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:58.295651 1545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:32:58.295668 1545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:32:58.302935 1545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:40285
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.254.keytab
--principal=oryx/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:40285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:58.304723 1545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:58.306245 1545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:58.319006 1555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:58.319056 1558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:58.319036 1556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:58.319344 1545 server_base.cc:1034] running on GCE node
I20260811 07:32:58.320331 1545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:58.322644 1545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:58.324079 1545 hybrid_clock.cc:648] HybridClock initialized: now 1786433578324065 us; error 86 us; skew 500 ppm
Aug 11 07:32:58 dist-test-slave-7z32 krb5kdc[1526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433578, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:58.335657 1545 init.cc:377] Logged in from keytab as oryx/127.22.4.254@KRBTEST.COM (short username oryx)
I20260811 07:32:58.337334 1545 webserver.cc:460] Webserver started at http://127.22.4.254:38597/ using document root <none> and password file <none>
I20260811 07:32:58.338328 1545 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:58.338426 1545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:58.338692 1545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:58.341760 1545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "f4f994441f684500b69ec316afc2ff9e"
format_stamp: "Formatted at 2026-08-11 07:32:58 on dist-test-slave-7z32"
server_key: "8a30ed83769ccde4556e33b87ec26103"
server_key_iv: "2b28ac768b214aa45aa0c90ac248e223"
server_key_version: "encryptionkey@0"
I20260811 07:32:58.342516 1545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "f4f994441f684500b69ec316afc2ff9e"
format_stamp: "Formatted at 2026-08-11 07:32:58 on dist-test-slave-7z32"
server_key: "8a30ed83769ccde4556e33b87ec26103"
server_key_iv: "2b28ac768b214aa45aa0c90ac248e223"
server_key_version: "encryptionkey@0"
I20260811 07:32:58.348551 1545 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.000s
I20260811 07:32:58.352854 1570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:58.355089 1545 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:32:58.355333 1545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "f4f994441f684500b69ec316afc2ff9e"
format_stamp: "Formatted at 2026-08-11 07:32:58 on dist-test-slave-7z32"
server_key: "8a30ed83769ccde4556e33b87ec26103"
server_key_iv: "2b28ac768b214aa45aa0c90ac248e223"
server_key_version: "encryptionkey@0"
I20260811 07:32:58.355535 1545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:58.372756 1545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:58.377429 1545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:58.377729 1545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:58.389240 1545 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:40285
I20260811 07:32:58.389312 1654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:40285 every 8 connection(s)
I20260811 07:32:58.390607 1545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:32:58.394367 1655 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:58.399935 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 1545
I20260811 07:32:58.400344 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:32:58.400786 22547 external_mini_cluster.cc:1428] Setting key a01ac7a95cb6e7ce7f44199254e84b29
I20260811 07:32:58.403522 1655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: Bootstrap starting.
I20260811 07:32:58.406311 1655 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:58.407477 1655 log.cc:824] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:58.412890 1655 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: No bootstrap required, opened a new log
Aug 11 07:32:58 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433578, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:58.419270 1655 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f994441f684500b69ec316afc2ff9e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40285 } }
I20260811 07:32:58.419790 1655 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:58.419915 1655 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f994441f684500b69ec316afc2ff9e, State: Initialized, Role: FOLLOWER
I20260811 07:32:58.420557 1655 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f994441f684500b69ec316afc2ff9e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40285 } }
I20260811 07:32:58.420841 1655 raft_consensus.cc:388] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:32:58.420958 1655 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:32:58.421106 1655 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:58.423009 1655 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f994441f684500b69ec316afc2ff9e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40285 } }
I20260811 07:32:58.423722 1655 leader_election.cc:302] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4f994441f684500b69ec316afc2ff9e; no voters:
I20260811 07:32:58.425325 1655 leader_election.cc:288] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:32:58.425573 1663 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:58.426003 1663 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [term 1 LEADER]: Becoming Leader. State: Replica: f4f994441f684500b69ec316afc2ff9e, State: Running, Role: LEADER
I20260811 07:32:58.426581 1663 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f994441f684500b69ec316afc2ff9e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40285 } }
I20260811 07:32:58.427282 1655 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:32:58.431041 1664 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4f994441f684500b69ec316afc2ff9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f994441f684500b69ec316afc2ff9e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40285 } } }
I20260811 07:32:58.431319 1664 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:58.431684 1665 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4f994441f684500b69ec316afc2ff9e. Latest consensus state: current_term: 1 leader_uuid: "f4f994441f684500b69ec316afc2ff9e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f994441f684500b69ec316afc2ff9e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 40285 } } }
I20260811 07:32:58.431808 1665 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e [sys.catalog]: This master's current role is: LEADER
I20260811 07:32:58.434568 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:58.402996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52946 (local address 127.22.4.254:40285)
0811 07:32:58.403795 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:58.403821 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:58.403882 (+ 61us) server_negotiation.cc:407] Connection header received
0811 07:32:58.405033 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:58.405068 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:58.405669 (+ 601us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:58.406187 (+ 518us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:58.407535 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.410667 (+ 3132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.412495 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.413697 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.414018 (+ 321us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:58.418326 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:58.418337 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:58.418365 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:58.418416 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:58.428066 (+ 9650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:58.429216 (+ 1150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:58.429228 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:58.429238 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:58.429501 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:58.430010 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:58.430015 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:58.430016 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:58.430943 (+ 927us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:58.431244 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:58.432680 (+ 1436us) server_negotiation.cc:299] Negotiation successful
0811 07:32:58.433180 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":204,"threads_started":1}
W20260811 07:32:58.434624 1683 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:32:58.435316 1683 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:32:58.435520 1684 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:32:58.436775 1684 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:32:58.450440 1684 catalog_manager.cc:1347] Generated new cluster ID: c087cd528cac4219851b8e7f4112365f
I20260811 07:32:58.450682 1684 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:32:58.469521 1684 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:32:58.470808 1684 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:32:58.477725 1684 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: Generated new TSK 0
I20260811 07:32:58.479156 1684 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab.
Entry for principal oryx/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab.
I20260811 07:32:58.533095 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40285
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab
--principal=oryx/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:58.686908 1694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:58.687315 1694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:58.687373 1694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:58.692143 1694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:58.692269 1694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:58.692319 1694 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:58.692359 1694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:32:58.699030 1694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab
--principal=oryx/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:40285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:58.700826 1694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:58.702332 1694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:58.718657 1699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:58.718657 1702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:58.718679 1704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:58.719003 1694 server_base.cc:1034] running on GCE node
I20260811 07:32:58.719815 1694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:58.720690 1694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:58.722014 1694 hybrid_clock.cc:648] HybridClock initialized: now 1786433578721957 us; error 82 us; skew 500 ppm
Aug 11 07:32:58 dist-test-slave-7z32 krb5kdc[1526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433578, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:58.726693 1694 init.cc:377] Logged in from keytab as oryx/127.22.4.193@KRBTEST.COM (short username oryx)
I20260811 07:32:58.728233 1694 webserver.cc:460] Webserver started at http://127.22.4.193:42523/ using document root <none> and password file <none>
I20260811 07:32:58.729147 1694 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:58.729233 1694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:58.729525 1694 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:58.732257 1694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "99284eff4ee246a09716472c60937bb9"
format_stamp: "Formatted at 2026-08-11 07:32:58 on dist-test-slave-7z32"
server_key: "71762730aaf669f71263da2b6e1f23fc"
server_key_iv: "09a3197e3a59a6d7300ec059af7a632e"
server_key_version: "encryptionkey@0"
I20260811 07:32:58.732908 1694 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "99284eff4ee246a09716472c60937bb9"
format_stamp: "Formatted at 2026-08-11 07:32:58 on dist-test-slave-7z32"
server_key: "71762730aaf669f71263da2b6e1f23fc"
server_key_iv: "09a3197e3a59a6d7300ec059af7a632e"
server_key_version: "encryptionkey@0"
I20260811 07:32:58.738598 1694 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:32:58.742484 1712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:58.744837 1694 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:32:58.745193 1694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "99284eff4ee246a09716472c60937bb9"
format_stamp: "Formatted at 2026-08-11 07:32:58 on dist-test-slave-7z32"
server_key: "71762730aaf669f71263da2b6e1f23fc"
server_key_iv: "09a3197e3a59a6d7300ec059af7a632e"
server_key_version: "encryptionkey@0"
I20260811 07:32:58.745378 1694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:58.763491 1694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:58.767884 1694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:58.768095 1694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:58.770088 1694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:58.770159 1694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:58.770205 1694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:58.770221 1694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:32:58 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433578, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:58.785518 1694 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:36447
I20260811 07:32:58.785868 1871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:36447 every 8 connection(s)
I20260811 07:32:58.787370 1694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:32:58.792673 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:58.771778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:50345 (local address 127.22.4.254:40285)
0811 07:32:58.771960 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:58.771965 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:58.773514 (+ 1549us) server_negotiation.cc:407] Connection header received
0811 07:32:58.775400 (+ 1886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:58.775405 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:58.775491 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:58.775610 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:58.778414 (+ 2804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.779443 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.781356 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.781673 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.781826 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:58.786662 (+ 4836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:58.786668 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:58.786670 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:58.786719 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:58.789483 (+ 2764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:58.790353 (+ 870us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:58.790358 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:58.790360 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:58.790487 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:58.791154 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:58.791158 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:58.791160 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:58.791457 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:58.791576 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:58.792327 (+ 751us) server_negotiation.cc:299] Negotiation successful
0811 07:32:58.792500 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:32:58.793617 1724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:58.772327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40285 (local address 127.22.4.193:50345)
0811 07:32:58.773223 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:58.773328 (+ 105us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:58.774975 (+ 1647us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:58.776030 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:58.776046 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:58.776853 (+ 807us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:58.778064 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:58.778098 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.779665 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.779669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:58.781168 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:58.781184 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.781906 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.781911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:58.782227 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:58.783506 (+ 1279us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:58.783543 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:58.786276 (+ 2733us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:58.789757 (+ 3481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:58.789766 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:58.789782 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:58.790163 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:58.790694 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:58.790697 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:58.790698 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:58.790994 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:58.791614 (+ 620us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:58.791621 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:58.791964 (+ 343us) client_negotiation.cc:769] Sending connection context
0811 07:32:58.792194 (+ 230us) client_negotiation.cc:240] Negotiation successful
0811 07:32:58.792587 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":190,"threads_started":1}
I20260811 07:32:58.795570 1872 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40285
I20260811 07:32:58.796038 1872 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:58.796365 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 1694
I20260811 07:32:58.796564 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:32:58.796913 1872 heartbeater.cc:511] Master 127.22.4.254:40285 requested a full tablet report, sending...
I20260811 07:32:58.797096 22547 external_mini_cluster.cc:1428] Setting key 5b5c0d1a80dc43dd3849f001443509d6
I20260811 07:32:58.799371 1593 ts_manager.cc:194] Registered new tserver with Master: 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447)
I20260811 07:32:58.801916 1593 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:50345
I20260811 07:32:58.815595 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:58.799679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:58183 (local address 127.22.4.254:40285)
0811 07:32:58.803085 (+ 3406us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:58.803092 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:58.803116 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:32:58.803186 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:58.803191 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:58.803260 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:58.803387 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:58.804518 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.805443 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.808370 (+ 2927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.808701 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.808836 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:58.811154 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:58.811159 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:58.811162 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:58.811200 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:58.813023 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:58.813880 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:58.813884 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:58.813885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:58.813992 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:58.814447 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:58.814450 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:58.814451 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:58.814680 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:58.814778 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:58.815285 (+ 507us) server_negotiation.cc:299] Negotiation successful
0811 07:32:58.815442 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3257}
I20260811 07:32:58.815770 1878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:58.799608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40285 (local address 127.22.4.193:58183)
0811 07:32:58.800067 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:58.800083 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:58.800197 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:58.803528 (+ 3331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:58.803535 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:58.803956 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:58.804229 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:58.804247 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.805710 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.805717 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:58.808066 (+ 2349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:58.808097 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:58.808914 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:58.808922 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:58.809086 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:58.809926 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:58.809954 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:58.810703 (+ 749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:58.813224 (+ 2521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:58.813232 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:58.813239 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:58.813705 (+ 466us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:58.814135 (+ 430us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:58.814141 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:58.814144 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:58.814289 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:58.814815 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:58.814819 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:58.815038 (+ 219us) client_negotiation.cc:769] Sending connection context
0811 07:32:58.815200 (+ 162us) client_negotiation.cc:240] Negotiation successful
0811 07:32:58.815447 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":227,"threads_started":1}
WARNING: no policy specified for oryx/127.22.4.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab.
Entry for principal oryx/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab.
I20260811 07:32:58.844561 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40285
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab
--principal=oryx/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:58.983678 1889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:58.984009 1889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:58.984061 1889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:58.988299 1889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:58.988390 1889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:58.988440 1889 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:58.988481 1889 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:32:58.995540 1889 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab
--principal=oryx/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:40285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:58.996948 1889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:58.998438 1889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:59.011535 1899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:59.011535 1903 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:59.011531 1898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:59.012115 1889 server_base.cc:1034] running on GCE node
I20260811 07:32:59.012794 1889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:59.013876 1889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:59.015141 1889 hybrid_clock.cc:648] HybridClock initialized: now 1786433579015090 us; error 78 us; skew 500 ppm
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433579, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:59.019234 1889 init.cc:377] Logged in from keytab as oryx/127.22.4.194@KRBTEST.COM (short username oryx)
I20260811 07:32:59.020810 1889 webserver.cc:460] Webserver started at http://127.22.4.194:38051/ using document root <none> and password file <none>
I20260811 07:32:59.021677 1889 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:59.021796 1889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:59.022131 1889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:59.025286 1889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "8866c9364f7e4f7daa83bce34b5ce415"
format_stamp: "Formatted at 2026-08-11 07:32:59 on dist-test-slave-7z32"
server_key: "6d49e672de112019e1026f4b2abe776d"
server_key_iv: "65b60e35955f86a18ad1c50156278d96"
server_key_version: "encryptionkey@0"
I20260811 07:32:59.026160 1889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "8866c9364f7e4f7daa83bce34b5ce415"
format_stamp: "Formatted at 2026-08-11 07:32:59 on dist-test-slave-7z32"
server_key: "6d49e672de112019e1026f4b2abe776d"
server_key_iv: "65b60e35955f86a18ad1c50156278d96"
server_key_version: "encryptionkey@0"
I20260811 07:32:59.032826 1889 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 07:32:59.037283 1911 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:59.039392 1889 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:32:59.039644 1889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "8866c9364f7e4f7daa83bce34b5ce415"
format_stamp: "Formatted at 2026-08-11 07:32:59 on dist-test-slave-7z32"
server_key: "6d49e672de112019e1026f4b2abe776d"
server_key_iv: "65b60e35955f86a18ad1c50156278d96"
server_key_version: "encryptionkey@0"
I20260811 07:32:59.039822 1889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:59.064988 1889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:59.069141 1889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:59.069402 1889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:59.071458 1889 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:59.071545 1889 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:59.071622 1889 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:59.071671 1889 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433579, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:59.086244 1889 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:43849
I20260811 07:32:59.087054 2074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:43849 every 8 connection(s)
I20260811 07:32:59.087867 1889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:32:59.090049 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.072885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:39221 (local address 127.22.4.254:40285)
0811 07:32:59.073115 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.073121 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.074190 (+ 1069us) server_negotiation.cc:407] Connection header received
0811 07:32:59.075696 (+ 1506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.075701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.075773 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.075831 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:59.077775 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.078587 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.080053 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.080302 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.080454 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.084729 (+ 4275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:59.084735 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:59.084739 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:59.084789 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:59.086963 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.087739 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.087746 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.087751 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.087875 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.088352 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.088356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.088357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.088706 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:59.088833 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.089704 (+ 871us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.089906 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 07:32:59.091156 1925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.073317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40285 (local address 127.22.4.194:39221)
0811 07:32:59.073933 (+ 616us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.073993 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.075360 (+ 1367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.076336 (+ 976us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.076348 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.076872 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:59.077594 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.077617 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.078747 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.078750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.079901 (+ 1151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.079913 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.080560 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.080568 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.080762 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.081619 (+ 857us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:59.081658 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:59.084436 (+ 2778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:59.087158 (+ 2722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.087167 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.087186 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.087556 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.088004 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.088009 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.088010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.088211 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.088908 (+ 697us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:59.088917 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:59.089296 (+ 379us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.089513 (+ 217us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.089905 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":195,"threads_started":1}
I20260811 07:32:59.092818 2075 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40285
I20260811 07:32:59.093068 2075 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:59.093770 2075 heartbeater.cc:511] Master 127.22.4.254:40285 requested a full tablet report, sending...
I20260811 07:32:59.095264 1593 ts_manager.cc:194] Registered new tserver with Master: 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849)
I20260811 07:32:59.096176 1593 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:39221
I20260811 07:32:59.098145 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 1889
I20260811 07:32:59.098325 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:32:59.098722 22547 external_mini_cluster.cc:1428] Setting key 4763cc58f43b0a33cb28456100945d47
I20260811 07:32:59.105759 2081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.095965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40285 (local address 127.22.4.194:54301)
0811 07:32:59.096382 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.096399 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.096529 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.096901 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.096906 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.097139 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:59.097267 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.097273 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.098434 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.098439 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.099334 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.099346 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.099931 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.099935 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.100056 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.100725 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:59.100739 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:59.101244 (+ 505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:59.103682 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.103687 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.103689 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.103954 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.104318 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.104323 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.104325 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.104460 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.105040 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:59.105046 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:59.105170 (+ 124us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.105301 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.105517 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":133,"threads_started":1}
I20260811 07:32:59.105746 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.096141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:54301 (local address 127.22.4.254:40285)
0811 07:32:59.096313 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.096319 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.096657 (+ 338us) server_negotiation.cc:407] Connection header received
0811 07:32:59.096708 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.096710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.096763 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.096837 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:59.097405 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.098227 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.099494 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.099795 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.099919 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.101449 (+ 1530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:59.101452 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:59.101455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:59.101486 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:59.103538 (+ 2052us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.104092 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.104098 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.104100 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.104205 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.104587 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.104593 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.104598 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.104901 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:59.105033 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.105370 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.105520 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":62}
WARNING: no policy specified for oryx/127.22.4.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab.
Entry for principal oryx/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab.
I20260811 07:32:59.136209 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:40285
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab
--principal=oryx/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44897
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:32:59.283349 2084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:32:59.283740 2084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:32:59.283792 2084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:32:59.288718 2084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:32:59.288864 2084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:32:59.288911 2084 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 07:32:59.288947 2084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:32:59.295670 2084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44897
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab
--principal=oryx/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.22.4.254:40285
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:32:59.297263 2084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:32:59.298509 2084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:32:59.311789 2096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:32:59.311791 2094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:59.312345 2084 server_base.cc:1034] running on GCE node
W20260811 07:32:59.311791 2091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:32:59.313120 2084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:32:59.314253 2084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:32:59.315692 2084 hybrid_clock.cc:648] HybridClock initialized: now 1786433579315613 us; error 103 us; skew 500 ppm
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433579, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:32:59.319749 2084 init.cc:377] Logged in from keytab as oryx/127.22.4.195@KRBTEST.COM (short username oryx)
I20260811 07:32:59.321034 2084 webserver.cc:460] Webserver started at http://127.22.4.195:38175/ using document root <none> and password file <none>
I20260811 07:32:59.321827 2084 fs_manager.cc:359] Metadata directory not provided
I20260811 07:32:59.321946 2084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:32:59.322240 2084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:32:59.324811 2084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "9571ee4f3c964981a90beb34c26b0f89"
format_stamp: "Formatted at 2026-08-11 07:32:59 on dist-test-slave-7z32"
server_key: "71a602c8184abb433bbec89ba4f962f1"
server_key_iv: "11a17eef125b3fe0c351c7205c2b775d"
server_key_version: "encryptionkey@0"
I20260811 07:32:59.325547 2084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "9571ee4f3c964981a90beb34c26b0f89"
format_stamp: "Formatted at 2026-08-11 07:32:59 on dist-test-slave-7z32"
server_key: "71a602c8184abb433bbec89ba4f962f1"
server_key_iv: "11a17eef125b3fe0c351c7205c2b775d"
server_key_version: "encryptionkey@0"
I20260811 07:32:59.331866 2084 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.006s
I20260811 07:32:59.338012 2105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:59.340579 2084 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 07:32:59.340905 2084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "9571ee4f3c964981a90beb34c26b0f89"
format_stamp: "Formatted at 2026-08-11 07:32:59 on dist-test-slave-7z32"
server_key: "71a602c8184abb433bbec89ba4f962f1"
server_key_iv: "11a17eef125b3fe0c351c7205c2b775d"
server_key_version: "encryptionkey@0"
I20260811 07:32:59.341117 2084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:32:59.357596 2084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:32:59.362216 2084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:32:59.362476 2084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:32:59.364511 2084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:32:59.364606 2084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:59.364673 2084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:32:59.364723 2084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:32:59.377786 2084 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:38161
I20260811 07:32:59.377956 2268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:38161 every 8 connection(s)
I20260811 07:32:59.379186 2084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433579, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:59.385648 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.366114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:49701 (local address 127.22.4.254:40285)
0811 07:32:59.366339 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.366346 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.367912 (+ 1566us) server_negotiation.cc:407] Connection header received
0811 07:32:59.369823 (+ 1911us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.369830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.369963 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.370176 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:59.372315 (+ 2139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.373277 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.375998 (+ 2721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.376457 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.376628 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.380443 (+ 3815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:59.380477 (+ 34us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:59.380484 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:59.380532 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:59.382339 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.383196 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.383200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.383202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.383317 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.384104 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.384108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.384109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.384388 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:59.384511 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.385308 (+ 797us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.385476 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:32:59.386996 2117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.366746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40285 (local address 127.22.4.195:49701)
0811 07:32:59.367647 (+ 901us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.367735 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.369383 (+ 1648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.370454 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.370468 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.371150 (+ 682us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:59.372026 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.372054 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.373518 (+ 1464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.373523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.375718 (+ 2195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.375745 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.376771 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.376776 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.377013 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.377935 (+ 922us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:59.377965 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:59.380092 (+ 2127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:59.382509 (+ 2417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.382515 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.382534 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.382967 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.383680 (+ 713us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.383683 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.383685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.383884 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.384601 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:59.384609 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:59.384963 (+ 354us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.385194 (+ 231us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.385601 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":224,"threads_started":1}
I20260811 07:32:59.389664 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 2084
I20260811 07:32:59.389878 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:32:59.390301 2269 heartbeater.cc:347] Connected to a master server at 127.22.4.254:40285
I20260811 07:32:59.390625 22547 external_mini_cluster.cc:1428] Setting key 5b8c28e2326091691194e2b18ed348db
I20260811 07:32:59.390694 2269 heartbeater.cc:464] Registering TS with master...
I20260811 07:32:59.391608 2269 heartbeater.cc:511] Master 127.22.4.254:40285 requested a full tablet report, sending...
I20260811 07:32:59.393431 1594 ts_manager.cc:194] Registered new tserver with Master: 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:32:59.394404 1594 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:49701
I20260811 07:32:59.405370 2277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.393454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40285 (local address 127.22.4.195:54235)
0811 07:32:59.394092 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.394110 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.394298 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.394676 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.394680 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.395014 (+ 334us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:59.395176 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.395188 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.396306 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.396310 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.396980 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.396990 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.397813 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.397818 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.397960 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.398777 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:59.398794 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:59.399409 (+ 615us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:59.402639 (+ 3230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.402644 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.402647 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.403010 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.403395 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.403398 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.403401 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.403520 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.404507 (+ 987us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:59.404514 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:59.404667 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.404804 (+ 137us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.405052 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":176,"threads_started":1}
I20260811 07:32:59.405666 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.393359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:54235 (local address 127.22.4.254:40285)
0811 07:32:59.393847 (+ 488us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.393853 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.394214 (+ 361us) server_negotiation.cc:407] Connection header received
0811 07:32:59.394440 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.394445 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.394510 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.394614 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:59.395336 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.396124 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.397126 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.397528 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.397645 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.399641 (+ 1996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:59.399648 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:59.399654 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:59.399706 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:59.402461 (+ 2755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.403156 (+ 695us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.403161 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.403163 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.403283 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.403899 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.403906 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.403908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.404319 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:59.404504 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.405313 (+ 809us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.405482 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378}
I20260811 07:32:59.407337 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433579, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:32:59.447590 1661 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:32:59.436874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60686 (local address 127.22.4.254:40285)
0811 07:32:59.437286 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.437290 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.437315 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:32:59.437389 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.437392 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.437461 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.437594 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:59.438793 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.439656 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.440908 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.441241 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.441508 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.447283 (+ 5775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60686: BlockingRecv error: recv got EOF from 127.0.0.1:60686 (error 108)
Metrics: {"server-negotiator.queue_time_us":153}
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433579, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:59.462106 1661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.449612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60688 (local address 127.22.4.254:40285)
0811 07:32:59.449839 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.449846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.449981 (+ 135us) server_negotiation.cc:407] Connection header received
0811 07:32:59.450228 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.450233 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.450298 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.450413 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:59.451404 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.452003 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.453528 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.454012 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.454222 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.457609 (+ 3387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:59.457614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:59.457617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:59.457665 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:59.459495 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.460284 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.460289 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.460290 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.460408 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.460891 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.460896 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.460897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.461250 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:59.461441 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.461716 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.461878 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 07:32:59.466107 1593 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60688:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:32:59.469551 1593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:59.490370 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.483183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36158 (local address 127.22.4.194:43849)
0811 07:32:59.483788 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.483801 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.484129 (+ 328us) server_negotiation.cc:407] Connection header received
0811 07:32:59.484416 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.484422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.484627 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.484770 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:59.485299 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.486439 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.488637 (+ 2198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.489577 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.489703 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.489877 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.490056 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.490164 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":174,"threads_started":1}
I20260811 07:32:59.490749 2300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.482781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46864 (local address 127.22.4.193:36447)
0811 07:32:59.483463 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.483473 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.483512 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:32:59.483776 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.483785 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.484099 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.484315 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:59.485017 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.486226 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.488292 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.489194 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.489340 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.489526 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.490332 (+ 806us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.490528 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":372,"threads_started":1}
I20260811 07:32:59.491496 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.483541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:43849 (local address 127.0.0.1:36158)
0811 07:32:59.483982 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.484002 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.484230 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.484992 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.484996 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.485016 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:59.485113 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.485117 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.486701 (+ 1584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.486706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.488437 (+ 1731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.488449 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.489732 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.489737 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.489871 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.489910 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.490000 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.490168 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":37,"thread_start_us":142,"threads_started":1}
I20260811 07:32:59.491496 2304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.484113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:38161 (local address 127.0.0.1:54290)
0811 07:32:59.484514 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.484534 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.484651 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.485529 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.485532 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.485553 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:59.485642 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.485650 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.488137 (+ 2487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.488142 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.489294 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.489310 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.490930 (+ 1620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.490934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.491039 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.491066 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.491142 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.491225 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"thread_start_us":111,"threads_started":1}
I20260811 07:32:59.491899 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.484432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54290 (local address 127.22.4.195:38161)
0811 07:32:59.484892 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.484942 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.484971 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:32:59.485056 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.485062 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.485334 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.485530 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:59.485802 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.487972 (+ 2170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.489494 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.490514 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.490656 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.491459 (+ 803us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.491537 (+ 78us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.491697 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":360,"thread_start_us":129,"threads_started":1}
I20260811 07:32:59.491583 2299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.482341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36447 (local address 127.0.0.1:46864)
0811 07:32:59.482971 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.483248 (+ 277us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.483511 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.484576 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.484583 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.484613 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:59.484827 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.484837 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.486398 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.486402 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.488138 (+ 1736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.488151 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.489359 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.489366 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.489530 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.489599 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.489755 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.491131 (+ 1376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":77,"thread_start_us":134,"threads_started":1}
I20260811 07:32:59.495476 2181 tablet_service.cc:1467] Processing CreateTablet for tablet 26dfa6ba8efb4d63a2f03c81cbfed057 (DEFAULT_TABLE table=test-table [id=68e0eec0aad44cf1ab6d200a4baa4425]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:59.495837 1978 tablet_service.cc:1467] Processing CreateTablet for tablet 26dfa6ba8efb4d63a2f03c81cbfed057 (DEFAULT_TABLE table=test-table [id=68e0eec0aad44cf1ab6d200a4baa4425]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:59.497057 2181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26dfa6ba8efb4d63a2f03c81cbfed057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:59.497457 1978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26dfa6ba8efb4d63a2f03c81cbfed057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:59.497051 1781 tablet_service.cc:1467] Processing CreateTablet for tablet 26dfa6ba8efb4d63a2f03c81cbfed057 (DEFAULT_TABLE table=test-table [id=68e0eec0aad44cf1ab6d200a4baa4425]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:59.498232 1781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 26dfa6ba8efb4d63a2f03c81cbfed057. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:59.506726 2308 tablet_bootstrap.cc:492] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Bootstrap starting.
I20260811 07:32:59.507731 2307 tablet_bootstrap.cc:492] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Bootstrap starting.
I20260811 07:32:59.508010 2310 tablet_bootstrap.cc:492] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Bootstrap starting.
I20260811 07:32:59.510097 2310 tablet_bootstrap.cc:654] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:59.510097 2308 tablet_bootstrap.cc:654] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:59.510893 2307 tablet_bootstrap.cc:654] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:59.511179 2310 log.cc:824] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:59.511179 2308 log.cc:824] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:59.512005 2307 log.cc:824] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Log is configured to *not* fsync() on all Append() calls
I20260811 07:32:59.513687 2310 tablet_bootstrap.cc:492] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: No bootstrap required, opened a new log
I20260811 07:32:59.513687 2308 tablet_bootstrap.cc:492] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: No bootstrap required, opened a new log
I20260811 07:32:59.513952 2308 ts_tablet_manager.cc:1397] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260811 07:32:59.514503 2307 tablet_bootstrap.cc:492] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: No bootstrap required, opened a new log
I20260811 07:32:59.513953 2310 ts_tablet_manager.cc:1397] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:32:59.515151 2307 ts_tablet_manager.cc:1397] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 07:32:59.519129 2307 raft_consensus.cc:348] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.519485 2307 raft_consensus.cc:374] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:59.519246 2308 raft_consensus.cc:348] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.519246 2310 raft_consensus.cc:348] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.519574 2308 raft_consensus.cc:374] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:59.519574 2310 raft_consensus.cc:374] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:59.519594 2307 raft_consensus.cc:729] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9571ee4f3c964981a90beb34c26b0f89, State: Initialized, Role: FOLLOWER
I20260811 07:32:59.519655 2310 raft_consensus.cc:729] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8866c9364f7e4f7daa83bce34b5ce415, State: Initialized, Role: FOLLOWER
I20260811 07:32:59.519699 2308 raft_consensus.cc:729] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99284eff4ee246a09716472c60937bb9, State: Initialized, Role: FOLLOWER
I20260811 07:32:59.520195 2307 consensus_queue.cc:260] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.520284 2308 consensus_queue.cc:260] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.520284 2310 consensus_queue.cc:260] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.521541 2310 ts_tablet_manager.cc:1428] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 07:32:59.521533 2269 heartbeater.cc:503] Master 127.22.4.254:40285 was elected leader, sending a full tablet report...
I20260811 07:32:59.521636 2307 ts_tablet_manager.cc:1428] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260811 07:32:59.521729 2075 heartbeater.cc:503] Master 127.22.4.254:40285 was elected leader, sending a full tablet report...
I20260811 07:32:59.521842 1872 heartbeater.cc:503] Master 127.22.4.254:40285 was elected leader, sending a full tablet report...
I20260811 07:32:59.523242 2308 ts_tablet_manager.cc:1428] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Time spent starting tablet: real 0.009s user 0.008s sys 0.001s
W20260811 07:32:59.539681 1873 tablet.cc:2369] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:32:59.589656 2076 tablet.cc:2369] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:32:59.630566 2270 tablet.cc:2369] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:32:59.728209 2321 raft_consensus.cc:482] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:59.728528 2321 raft_consensus.cc:504] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.730657 2321 leader_election.cc:288] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:32:59.735841 2322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.731106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36447 (local address 127.22.4.194:56191)
0811 07:32:59.731628 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.731643 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.731842 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.732190 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.732194 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.732214 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:59.732395 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.732402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.733332 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.733337 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.734312 (+ 975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.734323 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.735234 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.735239 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.735358 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.735388 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.735501 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.735616 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":446,"mutex_wait_us":37,"thread_start_us":197,"threads_started":1}
I20260811 07:32:59.735809 2300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.731282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:56191 (local address 127.22.4.193:36447)
0811 07:32:59.731469 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.731478 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.731758 (+ 280us) server_negotiation.cc:407] Connection header received
0811 07:32:59.731983 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.731987 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.732059 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.732162 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:59.732525 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.733181 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.734464 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.735075 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.735244 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.735323 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.735537 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.735631 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 07:32:59.736317 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.731162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:38161 (local address 127.22.4.194:52043)
0811 07:32:59.731709 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.731723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.731902 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.732181 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.732184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.732201 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:32:59.732355 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.732362 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.733146 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.733150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.734262 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.734274 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.735557 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.735562 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.735698 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.735736 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.735938 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.736093 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":91,"thread_start_us":130,"threads_started":1}
I20260811 07:32:59.736572 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.731386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:52043 (local address 127.22.4.195:38161)
0811 07:32:59.731552 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.731557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.731854 (+ 297us) server_negotiation.cc:407] Connection header received
0811 07:32:59.732022 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.732027 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.732077 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.732167 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:32:59.732468 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.733030 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.734454 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.735371 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.735563 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.735636 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.736295 (+ 659us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.736422 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:32:59.736867 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26dfa6ba8efb4d63a2f03c81cbfed057" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99284eff4ee246a09716472c60937bb9" is_pre_election: true
I20260811 07:32:59.737419 1810 raft_consensus.cc:2454] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 0.
I20260811 07:32:59.737352 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26dfa6ba8efb4d63a2f03c81cbfed057" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89" is_pre_election: true
I20260811 07:32:59.737696 2203 raft_consensus.cc:2454] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 0.
I20260811 07:32:59.738358 1917 leader_election.cc:302] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 9571ee4f3c964981a90beb34c26b0f89; no voters:
I20260811 07:32:59.738871 2321 raft_consensus.cc:2781] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:59.739049 2321 raft_consensus.cc:482] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:59.739137 2321 raft_consensus.cc:3037] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:59.740439 2321 raft_consensus.cc:504] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.740866 2321 leader_election.cc:288] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 election: Requested vote from peers 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:32:59.741614 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26dfa6ba8efb4d63a2f03c81cbfed057" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89"
I20260811 07:32:59.741614 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "26dfa6ba8efb4d63a2f03c81cbfed057" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99284eff4ee246a09716472c60937bb9"
I20260811 07:32:59.741866 2203 raft_consensus.cc:3037] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:59.741866 1810 raft_consensus.cc:3037] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:59.743753 1810 raft_consensus.cc:2454] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 1.
I20260811 07:32:59.744056 2203 raft_consensus.cc:2454] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 1.
I20260811 07:32:59.744361 1914 leader_election.cc:302] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 99284eff4ee246a09716472c60937bb9; no voters:
I20260811 07:32:59.744642 2321 raft_consensus.cc:2781] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:59.744895 2321 raft_consensus.cc:686] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 LEADER]: Becoming Leader. State: Replica: 8866c9364f7e4f7daa83bce34b5ce415, State: Running, Role: LEADER
I20260811 07:32:59.745401 2321 consensus_queue.cc:237] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.750102 1593 catalog_manager.cc:5495] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194). New cstate: current_term: 1 leader_uuid: "8866c9364f7e4f7daa83bce34b5ce415" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260811 07:32:59.797303 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.790800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36168 (local address 127.22.4.194:43849)
0811 07:32:59.791020 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.791024 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.791221 (+ 197us) server_negotiation.cc:407] Connection header received
0811 07:32:59.791453 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.791455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.791533 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.791650 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:32:59.792140 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.792816 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.794515 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.794803 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.794983 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.795525 (+ 542us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:32:59.796496 (+ 971us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:32:59.796627 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.796942 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.797077 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 07:32:59.806046 1810 raft_consensus.cc:1261] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Refusing update from remote peer 8866c9364f7e4f7daa83bce34b5ce415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:59.806254 2203 raft_consensus.cc:1261] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Refusing update from remote peer 8866c9364f7e4f7daa83bce34b5ce415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:32:59.807314 2325 consensus_queue.cc:1035] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:59.807591 2321 consensus_queue.cc:1035] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:32:59.820879 2330 mvcc.cc:205] Tried to move back new op lower bound from 7317231942874034176 to 7317231942641086464. Current Snapshot: MvccSnapshot[applied={T|T < 7317231942874034176}]
I20260811 07:32:59.823936 2331 mvcc.cc:205] Tried to move back new op lower bound from 7317231942874034176 to 7317231942641086464. Current Snapshot: MvccSnapshot[applied={T|T < 7317231942874034176 or (T in {7317231942874034176})}]
I20260811 07:32:59.830176 1593 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:59.830410 1593 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:32:59.834437 1593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: Sending DeleteTablet for 3 replicas of tablet 26dfa6ba8efb4d63a2f03c81cbfed057
I20260811 07:32:59.836314 2181 tablet_service.cc:1514] Processing DeleteTablet for tablet 26dfa6ba8efb4d63a2f03c81cbfed057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:59 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:54290
I20260811 07:32:59.836288 1781 tablet_service.cc:1514] Processing DeleteTablet for tablet 26dfa6ba8efb4d63a2f03c81cbfed057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:59 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:46864
I20260811 07:32:59.836390 1978 tablet_service.cc:1514] Processing DeleteTablet for tablet 26dfa6ba8efb4d63a2f03c81cbfed057 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:32:59 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:36158
I20260811 07:32:59.837246 2345 tablet_replica.cc:330] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: stopping tablet replica
I20260811 07:32:59.837700 2345 raft_consensus.cc:2229] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:59.837787 2346 tablet_replica.cc:330] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: stopping tablet replica
I20260811 07:32:59.838119 2346 raft_consensus.cc:2229] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:32:59.838352 2345 raft_consensus.cc:2258] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:59.838362 1593 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60688:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:32:59.838622 2346 raft_consensus.cc:2258] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 07:32:59.839258 1593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:32:59.839619 2344 tablet_replica.cc:330] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: stopping tablet replica
I20260811 07:32:59.840480 2345 ts_tablet_manager.cc:1905] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:59.840474 2346 ts_tablet_manager.cc:1905] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:59.840915 2344 raft_consensus.cc:2229] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:32:59.841373 2344 raft_consensus.cc:2258] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:32:59.844333 2346 ts_tablet_manager.cc:1918] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:59.844554 2346 log.cc:1196] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/26dfa6ba8efb4d63a2f03c81cbfed057
I20260811 07:32:59.845089 2346 ts_tablet_manager.cc:1939] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 8866c9364f7e4f7daa83bce34b5ce415: Deleting consensus metadata
I20260811 07:32:59.846982 1576 catalog_manager.cc:4841] TS 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849): tablet 26dfa6ba8efb4d63a2f03c81cbfed057 (table test-table [id=68e0eec0aad44cf1ab6d200a4baa4425]) successfully deleted
I20260811 07:32:59.848264 1781 tablet_service.cc:1467] Processing CreateTablet for tablet f3a100d5c3744a50bcea18fe0d1a52ba (DEFAULT_TABLE table=test-table [id=3e4ee2ed29154759a56fb32239a7c78f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:59.848498 2181 tablet_service.cc:1467] Processing CreateTablet for tablet f3a100d5c3744a50bcea18fe0d1a52ba (DEFAULT_TABLE table=test-table [id=3e4ee2ed29154759a56fb32239a7c78f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:59.848727 1781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3a100d5c3744a50bcea18fe0d1a52ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:59.848776 2344 ts_tablet_manager.cc:1905] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:32:59.848846 2181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3a100d5c3744a50bcea18fe0d1a52ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:59.849607 1978 tablet_service.cc:1467] Processing CreateTablet for tablet f3a100d5c3744a50bcea18fe0d1a52ba (DEFAULT_TABLE table=test-table [id=3e4ee2ed29154759a56fb32239a7c78f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:32:59.849920 1978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f3a100d5c3744a50bcea18fe0d1a52ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:32:59.851609 2345 ts_tablet_manager.cc:1918] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:59.853109 2310 tablet_bootstrap.cc:492] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: Bootstrap starting.
I20260811 07:32:59.854077 2344 ts_tablet_manager.cc:1918] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:32:59.854194 2344 log.cc:1196] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/26dfa6ba8efb4d63a2f03c81cbfed057
I20260811 07:32:59.854422 2310 tablet_bootstrap.cc:654] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:59.854610 2344 ts_tablet_manager.cc:1939] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 9571ee4f3c964981a90beb34c26b0f89: Deleting consensus metadata
I20260811 07:32:59.852804 2308 tablet_bootstrap.cc:492] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: Bootstrap starting.
I20260811 07:32:59.856088 2307 tablet_bootstrap.cc:492] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: Bootstrap starting.
I20260811 07:32:59.857128 2308 tablet_bootstrap.cc:654] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:59.857268 2307 tablet_bootstrap.cc:654] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: Neither blocks nor log segments found. Creating new log.
I20260811 07:32:59.857859 2310 tablet_bootstrap.cc:492] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: No bootstrap required, opened a new log
I20260811 07:32:59.857969 2310 ts_tablet_manager.cc:1397] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 07:32:59.858763 2307 tablet_bootstrap.cc:492] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: No bootstrap required, opened a new log
I20260811 07:32:59.858901 2307 ts_tablet_manager.cc:1397] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:59.859083 2345 log.cc:1196] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/26dfa6ba8efb4d63a2f03c81cbfed057
I20260811 07:32:59.859527 2345 ts_tablet_manager.cc:1939] T 26dfa6ba8efb4d63a2f03c81cbfed057 P 99284eff4ee246a09716472c60937bb9: Deleting consensus metadata
I20260811 07:32:59.859444 2307 raft_consensus.cc:348] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.859583 2307 raft_consensus.cc:374] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:59.859622 2307 raft_consensus.cc:729] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9571ee4f3c964981a90beb34c26b0f89, State: Initialized, Role: FOLLOWER
I20260811 07:32:59.859769 2307 consensus_queue.cc:260] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.860064 2307 ts_tablet_manager.cc:1428] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:32:59.860031 2310 raft_consensus.cc:348] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.860168 2310 raft_consensus.cc:374] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:59.860205 2310 raft_consensus.cc:729] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8866c9364f7e4f7daa83bce34b5ce415, State: Initialized, Role: FOLLOWER
I20260811 07:32:59.860383 2310 consensus_queue.cc:260] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.860769 2310 ts_tablet_manager.cc:1428] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:32:59.861178 1575 catalog_manager.cc:4841] TS 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447): tablet 26dfa6ba8efb4d63a2f03c81cbfed057 (table test-table [id=68e0eec0aad44cf1ab6d200a4baa4425]) successfully deleted
I20260811 07:32:59.861178 1576 catalog_manager.cc:4841] TS 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161): tablet 26dfa6ba8efb4d63a2f03c81cbfed057 (table test-table [id=68e0eec0aad44cf1ab6d200a4baa4425]) successfully deleted
I20260811 07:32:59.863692 2308 tablet_bootstrap.cc:492] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: No bootstrap required, opened a new log
I20260811 07:32:59.863818 2308 ts_tablet_manager.cc:1397] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s
I20260811 07:32:59.864383 2308 raft_consensus.cc:348] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.864531 2308 raft_consensus.cc:374] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:32:59.864580 2308 raft_consensus.cc:729] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99284eff4ee246a09716472c60937bb9, State: Initialized, Role: FOLLOWER
I20260811 07:32:59.864712 2308 consensus_queue.cc:260] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.865024 2308 ts_tablet_manager.cc:1428] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:32:59.917771 2321 raft_consensus.cc:482] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:32:59.917994 2321 raft_consensus.cc:504] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.918604 2321 leader_election.cc:288] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:32:59.919266 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3a100d5c3744a50bcea18fe0d1a52ba" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89" is_pre_election: true
I20260811 07:32:59.919299 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3a100d5c3744a50bcea18fe0d1a52ba" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99284eff4ee246a09716472c60937bb9" is_pre_election: true
I20260811 07:32:59.919456 2203 raft_consensus.cc:2454] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 0.
I20260811 07:32:59.919561 1810 raft_consensus.cc:2454] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 0.
I20260811 07:32:59.919906 1917 leader_election.cc:302] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 9571ee4f3c964981a90beb34c26b0f89; no voters:
I20260811 07:32:59.920145 2321 raft_consensus.cc:2781] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:32:59.920217 2321 raft_consensus.cc:482] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:32:59.920245 2321 raft_consensus.cc:3037] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:59.921308 2321 raft_consensus.cc:504] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.921801 2321 leader_election.cc:288] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 election: Requested vote from peers 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:32:59.922223 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3a100d5c3744a50bcea18fe0d1a52ba" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99284eff4ee246a09716472c60937bb9"
I20260811 07:32:59.922394 1810 raft_consensus.cc:3037] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:59.922365 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f3a100d5c3744a50bcea18fe0d1a52ba" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89"
I20260811 07:32:59.922544 2203 raft_consensus.cc:3037] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:32:59.923760 1810 raft_consensus.cc:2454] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 1.
I20260811 07:32:59.924142 1914 leader_election.cc:302] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 99284eff4ee246a09716472c60937bb9; no voters:
I20260811 07:32:59.924350 2321 raft_consensus.cc:2781] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:32:59.924419 2203 raft_consensus.cc:2454] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 1.
I20260811 07:32:59.924487 2321 raft_consensus.cc:686] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 LEADER]: Becoming Leader. State: Replica: 8866c9364f7e4f7daa83bce34b5ce415, State: Running, Role: LEADER
I20260811 07:32:59.924685 2321 consensus_queue.cc:237] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:32:59.927644 1593 catalog_manager.cc:5495] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194). New cstate: current_term: 1 leader_uuid: "8866c9364f7e4f7daa83bce34b5ce415" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } health_report { overall_health: UNKNOWN } } }
Aug 11 07:32:59 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433578, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.254@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:32:59.995939 2365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.985423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60700 (local address 127.22.4.254:40285)
0811 07:32:59.985793 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0811 07:32:59.985802 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:32:59.985986 (+ 184us) server_negotiation.cc:407] Connection header received
0811 07:32:59.986168 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:32:59.986171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:32:59.986219 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:32:59.986316 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:32:59.987169 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.987728 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.988532 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.988839 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.988958 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.991884 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:32:59.991888 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:32:59.991891 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:32:59.991922 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:32:59.993823 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.994401 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.994405 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.994407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.994495 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:32:59.994788 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:32:59.994791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:32:59.994794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:32:59.995089 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:32:59.995206 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:32:59.995530 (+ 324us) server_negotiation.cc:299] Negotiation successful
0811 07:32:59.995764 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":107,"server-negotiator.queue_time_us":317,"thread_start_us":214,"threads_started":1}
I20260811 07:32:59.995954 2364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:32:59.985334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:40285 (local address 127.0.0.1:60700)
0811 07:32:59.985813 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 07:32:59.985832 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:32:59.986058 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:32:59.986338 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:32:59.986341 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:32:59.986895 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:32:59.987037 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.987044 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.987843 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.987848 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.988409 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:32:59.988417 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:32:59.988968 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:32:59.988971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:32:59.989053 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:32:59.989971 (+ 918us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:32:59.989983 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:32:59.991723 (+ 1740us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:32:59.994001 (+ 2278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.994013 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.994023 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.994281 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.994592 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:32:59.994597 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:32:59.994599 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:32:59.994689 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:32:59.995206 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:32:59.995217 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:32:59.995342 (+ 125us) client_negotiation.cc:769] Sending connection context
0811 07:32:59.995466 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 07:32:59.995688 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":206,"threads_started":1}
I20260811 07:33:00.004624 1593 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:60700:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 07:33:00.005538 1593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:33:00.013032 1978 tablet_service.cc:1467] Processing CreateTablet for tablet ba4d59aabcfa49d89574c1fc8efff829 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b23a975d741479fa7557d009a4a0c36]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:33:00.013106 1781 tablet_service.cc:1467] Processing CreateTablet for tablet ba4d59aabcfa49d89574c1fc8efff829 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b23a975d741479fa7557d009a4a0c36]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:33:00.013576 1978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba4d59aabcfa49d89574c1fc8efff829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.013855 1781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba4d59aabcfa49d89574c1fc8efff829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.015628 2181 tablet_service.cc:1467] Processing CreateTablet for tablet ba4d59aabcfa49d89574c1fc8efff829 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1b23a975d741479fa7557d009a4a0c36]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 07:33:00.016151 2181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba4d59aabcfa49d89574c1fc8efff829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.017460 2310 tablet_bootstrap.cc:492] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: Bootstrap starting.
I20260811 07:33:00.018567 2310 tablet_bootstrap.cc:654] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.018800 2308 tablet_bootstrap.cc:492] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: Bootstrap starting.
I20260811 07:33:00.020093 2310 tablet_bootstrap.cc:492] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: No bootstrap required, opened a new log
I20260811 07:33:00.020201 2310 ts_tablet_manager.cc:1397] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 07:33:00.020601 2308 tablet_bootstrap.cc:654] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.020694 2310 raft_consensus.cc:348] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.020855 2310 raft_consensus.cc:374] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.020896 2310 raft_consensus.cc:729] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8866c9364f7e4f7daa83bce34b5ce415, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.021040 2310 consensus_queue.cc:260] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.021355 2310 ts_tablet_manager.cc:1428] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260811 07:33:00.021533 2307 tablet_bootstrap.cc:492] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: Bootstrap starting.
I20260811 07:33:00.021602 2321 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.021752 2321 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:33:00.022768 2307 tablet_bootstrap.cc:654] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.024230 2307 tablet_bootstrap.cc:492] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: No bootstrap required, opened a new log
I20260811 07:33:00.024348 2307 ts_tablet_manager.cc:1397] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s
I20260811 07:33:00.024602 2308 tablet_bootstrap.cc:492] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: No bootstrap required, opened a new log
I20260811 07:33:00.024727 2308 ts_tablet_manager.cc:1397] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.003s
I20260811 07:33:00.024876 2307 raft_consensus.cc:348] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.025008 2307 raft_consensus.cc:374] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.025038 2307 raft_consensus.cc:729] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9571ee4f3c964981a90beb34c26b0f89, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.025213 2307 consensus_queue.cc:260] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.025290 2308 raft_consensus.cc:348] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.025447 2308 raft_consensus.cc:374] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.025485 2308 raft_consensus.cc:729] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99284eff4ee246a09716472c60937bb9, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.025492 2307 ts_tablet_manager.cc:1428] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:33:00.025552 2318 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.025660 2308 consensus_queue.cc:260] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.025779 2318 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:33:00.025914 2317 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.026046 2317 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:33:00.026292 2308 ts_tablet_manager.cc:1428] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 07:33:00.048094 2317 raft_consensus.cc:482] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:33:00.048313 2317 raft_consensus.cc:504] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.049883 2317 leader_election.cc:288] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:33:00.055430 2305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.051212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:48965 (local address 127.22.4.195:38161)
0811 07:33:00.051367 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.051372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.051670 (+ 298us) server_negotiation.cc:407] Connection header received
0811 07:33:00.051894 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.051897 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.051954 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.052035 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:33:00.052375 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.052999 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.054241 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.054679 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.054880 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.054954 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.055137 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.055234 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:33:00.055533 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.050487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:52089 (local address 127.22.4.194:43849)
0811 07:33:00.050755 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.050761 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.051064 (+ 303us) server_negotiation.cc:407] Connection header received
0811 07:33:00.051353 (+ 289us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.051357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.051414 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.051474 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:33:00.051991 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.052717 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.053921 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.054461 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.054643 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.054712 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.055170 (+ 458us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.055269 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:33:00.055569 2372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.051041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:38161 (local address 127.22.4.193:48965)
0811 07:33:00.051557 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:00.051573 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:00.051752 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:00.052048 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:00.052051 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:00.052069 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:33:00.052192 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.052198 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.053190 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.053232 (+ 42us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.054071 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.054084 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.054860 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.054864 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.054984 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.055010 (+ 26us) client_negotiation.cc:769] Sending connection context
0811 07:33:00.055120 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 07:33:00.055309 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":442,"mutex_wait_us":52,"thread_start_us":104,"threads_started":1}
I20260811 07:33:00.055576 2370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.050406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:43849 (local address 127.22.4.193:52089)
0811 07:33:00.050945 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:00.050963 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:00.051181 (+ 218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:00.051646 (+ 465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:00.051650 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:00.051669 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:33:00.051856 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.051867 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.052841 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.052845 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.053763 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.053775 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.054644 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.054648 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.054798 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.055024 (+ 226us) client_negotiation.cc:769] Sending connection context
0811 07:33:00.055147 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 07:33:00.055340 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"mutex_wait_us":37,"thread_start_us":211,"threads_started":1}
I20260811 07:33:00.056526 2007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4d59aabcfa49d89574c1fc8efff829" candidate_uuid: "99284eff4ee246a09716472c60937bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8866c9364f7e4f7daa83bce34b5ce415" is_pre_election: true
I20260811 07:33:00.056656 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4d59aabcfa49d89574c1fc8efff829" candidate_uuid: "99284eff4ee246a09716472c60937bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89" is_pre_election: true
I20260811 07:33:00.056865 2007 raft_consensus.cc:2454] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99284eff4ee246a09716472c60937bb9 in term 0.
I20260811 07:33:00.056922 2203 raft_consensus.cc:2454] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99284eff4ee246a09716472c60937bb9 in term 0.
I20260811 07:33:00.057387 1718 leader_election.cc:302] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9571ee4f3c964981a90beb34c26b0f89, 99284eff4ee246a09716472c60937bb9; no voters:
I20260811 07:33:00.057752 2317 raft_consensus.cc:2781] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:33:00.057869 2317 raft_consensus.cc:482] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:33:00.057925 2317 raft_consensus.cc:3037] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.059659 2317 raft_consensus.cc:504] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.060072 2317 leader_election.cc:288] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [CANDIDATE]: Term 1 election: Requested vote from peers 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:33:00.060643 2007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4d59aabcfa49d89574c1fc8efff829" candidate_uuid: "99284eff4ee246a09716472c60937bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8866c9364f7e4f7daa83bce34b5ce415"
I20260811 07:33:00.060853 2007 raft_consensus.cc:3037] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.060839 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba4d59aabcfa49d89574c1fc8efff829" candidate_uuid: "99284eff4ee246a09716472c60937bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89"
I20260811 07:33:00.061014 2203 raft_consensus.cc:3037] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.062115 2007 raft_consensus.cc:2454] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99284eff4ee246a09716472c60937bb9 in term 1.
I20260811 07:33:00.062237 2203 raft_consensus.cc:2454] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99284eff4ee246a09716472c60937bb9 in term 1.
I20260811 07:33:00.062512 1718 leader_election.cc:302] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 99284eff4ee246a09716472c60937bb9; no voters:
I20260811 07:33:00.062817 2317 raft_consensus.cc:2781] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:33:00.063215 2317 raft_consensus.cc:686] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [term 1 LEADER]: Becoming Leader. State: Replica: 99284eff4ee246a09716472c60937bb9, State: Running, Role: LEADER
I20260811 07:33:00.063606 2317 consensus_queue.cc:237] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.065513 2373 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: TxnStatusTablet state changed. Reason: New leader 99284eff4ee246a09716472c60937bb9. Latest consensus state: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.065689 2373 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:33:00.066064 2375 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 07:33:00.066313 2375 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 07:33:00.067075 1594 catalog_manager.cc:5495] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99284eff4ee246a09716472c60937bb9 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260811 07:33:00.093778 2364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.087310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36447 (local address 127.0.0.1:46872)
0811 07:33:00.087691 (+ 381us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:00.087712 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:00.087884 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:00.088382 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:00.088386 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:00.088395 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:33:00.088564 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.088572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.089674 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.089679 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.091022 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.091047 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.091846 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.091851 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.091997 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.092083 (+ 86us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.093290 (+ 1207us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.093313 (+ 23us) client_negotiation.cc:769] Sending connection context
0811 07:33:00.093409 (+ 96us) client_negotiation.cc:240] Negotiation successful
0811 07:33:00.093599 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229}
I20260811 07:33:00.093775 2300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.087439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46872 (local address 127.22.4.193:36447)
0811 07:33:00.087582 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.087587 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.087808 (+ 221us) server_negotiation.cc:407] Connection header received
0811 07:33:00.088089 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.088093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.088173 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.088332 (+ 159us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:33:00.088706 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.089491 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.091231 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.091649 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.091800 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.092316 (+ 516us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.093156 (+ 840us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.093303 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.093452 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.093560 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:33:00.098552 2203 raft_consensus.cc:1261] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Refusing update from remote peer 99284eff4ee246a09716472c60937bb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:00.098616 2007 raft_consensus.cc:1261] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Refusing update from remote peer 99284eff4ee246a09716472c60937bb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:00.099396 2317 consensus_queue.cc:1035] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:00.099957 2317 consensus_queue.cc:1035] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:00.101615 2318 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: TxnStatusTablet state changed. Reason: New leader 99284eff4ee246a09716472c60937bb9. Latest consensus state: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.101802 2318 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:33:00.103780 2321 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: TxnStatusTablet state changed. Reason: New leader 99284eff4ee246a09716472c60937bb9. Latest consensus state: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.103948 2321 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:33:00.105841 2318 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.106001 2318 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 9571ee4f3c964981a90beb34c26b0f89: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:33:00.106004 2317 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.106134 2317 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:33:00.106330 2373 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.106422 2373 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 99284eff4ee246a09716472c60937bb9: This TxnStatusTablet replica's current role is: LEADER
I20260811 07:33:00.111369 2321 tablet_replica.cc:439] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } } }
I20260811 07:33:00.111534 2321 tablet_replica.cc:442] T ba4d59aabcfa49d89574c1fc8efff829 P 8866c9364f7e4f7daa83bce34b5ce415: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 07:33:00.126209 2387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.121042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36447 (local address 127.22.4.194:50111)
0811 07:33:00.121428 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:00.121444 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:00.121599 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:00.121993 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:00.121995 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:00.122003 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:33:00.122217 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.122225 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.123506 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.123510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.124407 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.124420 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.125212 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.125215 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.125299 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.125379 (+ 80us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.125870 (+ 491us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.125878 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:33:00.125966 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:33:00.126060 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":151,"threads_started":1}
I20260811 07:33:00.126272 2300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.121229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:50111 (local address 127.22.4.193:36447)
0811 07:33:00.121417 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.121424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.121564 (+ 140us) server_negotiation.cc:407] Connection header received
0811 07:33:00.121748 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.121753 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.121831 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.121969 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:33:00.122360 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.123339 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.124555 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.124916 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.125061 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.125564 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.125686 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.125771 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.126001 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.126094 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:33:00.139151 1810 raft_consensus.cc:1261] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Refusing update from remote peer 8866c9364f7e4f7daa83bce34b5ce415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:00.139292 2203 raft_consensus.cc:1261] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Refusing update from remote peer 8866c9364f7e4f7daa83bce34b5ce415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:00.139906 2321 consensus_queue.cc:1035] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:00.140380 2336 consensus_queue.cc:1035] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:00.143859 2328 mvcc.cc:205] Tried to move back new op lower bound from 7317231944244379648 to 7317231943373082624. Current Snapshot: MvccSnapshot[applied={T|T < 7317231944244379648}]
I20260811 07:33:00.169328 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.163887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:60833 (local address 127.22.4.194:43849)
0811 07:33:00.164060 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.164066 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.164482 (+ 416us) server_negotiation.cc:407] Connection header received
0811 07:33:00.164760 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.164767 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.164855 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.164953 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:33:00.165389 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.166036 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.167676 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.168086 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.168193 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.168743 (+ 550us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.168840 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.168928 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.169120 (+ 192us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.169195 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:33:00.169422 2395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.163723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:43849 (local address 127.22.4.193:60833)
0811 07:33:00.164361 (+ 638us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:00.164381 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:00.164594 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:00.164993 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:00.164996 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:00.165006 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:33:00.165211 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.165219 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.166187 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.166191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.167478 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.167498 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.168339 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.168342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.168448 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.168528 (+ 80us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.168965 (+ 437us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.168973 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:33:00.169064 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:33:00.169187 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"thread_start_us":154,"threads_started":1}
I20260811 07:33:00.206480 1590 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:33:00.206744 1590 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:60688:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:33:00.210527 1590 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: Sending DeleteTablet for 3 replicas of tablet f3a100d5c3744a50bcea18fe0d1a52ba
I20260811 07:33:00.211483 1781 tablet_service.cc:1514] Processing DeleteTablet for tablet f3a100d5c3744a50bcea18fe0d1a52ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:46864
I20260811 07:33:00.211648 1978 tablet_service.cc:1514] Processing DeleteTablet for tablet f3a100d5c3744a50bcea18fe0d1a52ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:36158
I20260811 07:33:00.211719 2345 tablet_replica.cc:330] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: stopping tablet replica
I20260811 07:33:00.211723 2181 tablet_service.cc:1514] Processing DeleteTablet for tablet f3a100d5c3744a50bcea18fe0d1a52ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:54290
I20260811 07:33:00.211825 2346 tablet_replica.cc:330] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: stopping tablet replica
I20260811 07:33:00.211869 2345 raft_consensus.cc:2229] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:33:00.211944 2346 raft_consensus.cc:2229] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:33:00.212013 2345 raft_consensus.cc:2258] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.212023 2344 tablet_replica.cc:330] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: stopping tablet replica
I20260811 07:33:00.212152 2346 raft_consensus.cc:2258] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.212175 2344 raft_consensus.cc:2229] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:33:00.212335 2344 raft_consensus.cc:2258] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.213608 2345 ts_tablet_manager.cc:1905] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:00.214088 2344 ts_tablet_manager.cc:1905] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:00.218187 2346 ts_tablet_manager.cc:1905] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:00.218286 2344 ts_tablet_manager.cc:1918] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:33:00.218408 2344 log.cc:1196] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/f3a100d5c3744a50bcea18fe0d1a52ba
I20260811 07:33:00.218741 2344 ts_tablet_manager.cc:1939] T f3a100d5c3744a50bcea18fe0d1a52ba P 9571ee4f3c964981a90beb34c26b0f89: Deleting consensus metadata
I20260811 07:33:00.220573 1576 catalog_manager.cc:4841] TS 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161): tablet f3a100d5c3744a50bcea18fe0d1a52ba (table test-table [id=3e4ee2ed29154759a56fb32239a7c78f]) successfully deleted
I20260811 07:33:00.221760 2346 ts_tablet_manager.cc:1918] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:33:00.222031 2346 log.cc:1196] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/f3a100d5c3744a50bcea18fe0d1a52ba
I20260811 07:33:00.223367 2345 ts_tablet_manager.cc:1918] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:33:00.223495 2345 log.cc:1196] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/f3a100d5c3744a50bcea18fe0d1a52ba
I20260811 07:33:00.223778 2345 ts_tablet_manager.cc:1939] T f3a100d5c3744a50bcea18fe0d1a52ba P 99284eff4ee246a09716472c60937bb9: Deleting consensus metadata
I20260811 07:33:00.224229 2346 ts_tablet_manager.cc:1939] T f3a100d5c3744a50bcea18fe0d1a52ba P 8866c9364f7e4f7daa83bce34b5ce415: Deleting consensus metadata
I20260811 07:33:00.225046 1575 catalog_manager.cc:4841] TS 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447): tablet f3a100d5c3744a50bcea18fe0d1a52ba (table test-table [id=3e4ee2ed29154759a56fb32239a7c78f]) successfully deleted
I20260811 07:33:00.225329 1576 catalog_manager.cc:4841] TS 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849): tablet f3a100d5c3744a50bcea18fe0d1a52ba (table test-table [id=3e4ee2ed29154759a56fb32239a7c78f]) successfully deleted
Aug 11 07:33:00 dist-test-slave-7z32 krb5kdc[1526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 07:33:00 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:00 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:33:00.257754 2365 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:00.248186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60702 (local address 127.22.4.254:40285)
0811 07:33:00.248416 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.248423 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.248893 (+ 470us) server_negotiation.cc:407] Connection header received
0811 07:33:00.249117 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.249120 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.249206 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.249302 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:00.250708 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.251397 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.252932 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.253175 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.253280 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.257592 (+ 4312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60702: BlockingRecv error: recv got EOF from 127.0.0.1:60702 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
Aug 11 07:33:00 dist-test-slave-7z32 krb5kdc[1526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM
I20260811 07:33:00.272080 2365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.259882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60712 (local address 127.22.4.254:40285)
0811 07:33:00.260093 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.260100 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.260127 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:33:00.260275 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.260279 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.260361 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.260510 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:00.261489 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.262456 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.263613 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.264008 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.264166 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.267304 (+ 3138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:00.267309 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:00.267313 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:00.267360 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:00.269706 (+ 2346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:00.270338 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:00.270343 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:00.270345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:00.270477 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:00.270813 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:00.270816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:00.270818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:00.271168 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:00.271331 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.271658 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.271848 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 07:33:00.275753 1590 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:33:00.276319 1590 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:33:00.282891 1781 tablet_service.cc:1467] Processing CreateTablet for tablet fd3bd83dd57f4dc199c35d437f9627ae (DEFAULT_TABLE table=test-table [id=27373f0a8b6648d0b90a9e2f31840f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:00.283085 1978 tablet_service.cc:1467] Processing CreateTablet for tablet fd3bd83dd57f4dc199c35d437f9627ae (DEFAULT_TABLE table=test-table [id=27373f0a8b6648d0b90a9e2f31840f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:00.283301 1781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd3bd83dd57f4dc199c35d437f9627ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.283545 1978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd3bd83dd57f4dc199c35d437f9627ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.285822 2308 tablet_bootstrap.cc:492] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: Bootstrap starting.
I20260811 07:33:00.286761 2308 tablet_bootstrap.cc:654] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.286973 2310 tablet_bootstrap.cc:492] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: Bootstrap starting.
I20260811 07:33:00.287492 2181 tablet_service.cc:1467] Processing CreateTablet for tablet fd3bd83dd57f4dc199c35d437f9627ae (DEFAULT_TABLE table=test-table [id=27373f0a8b6648d0b90a9e2f31840f50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:00.287940 2181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fd3bd83dd57f4dc199c35d437f9627ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.287976 2310 tablet_bootstrap.cc:654] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.289197 2308 tablet_bootstrap.cc:492] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: No bootstrap required, opened a new log
I20260811 07:33:00.289193 2310 tablet_bootstrap.cc:492] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: No bootstrap required, opened a new log
I20260811 07:33:00.289291 2308 ts_tablet_manager.cc:1397] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 07:33:00.289302 2310 ts_tablet_manager.cc:1397] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:33:00.289736 2310 raft_consensus.cc:348] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.289757 2308 raft_consensus.cc:348] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.289878 2308 raft_consensus.cc:374] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.289871 2310 raft_consensus.cc:374] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.289918 2308 raft_consensus.cc:729] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99284eff4ee246a09716472c60937bb9, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.289937 2310 raft_consensus.cc:729] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8866c9364f7e4f7daa83bce34b5ce415, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.290073 2310 consensus_queue.cc:260] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.290073 2308 consensus_queue.cc:260] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.290355 2310 ts_tablet_manager.cc:1428] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:33:00.290367 2308 ts_tablet_manager.cc:1428] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:33:00.294689 2307 tablet_bootstrap.cc:492] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: Bootstrap starting.
I20260811 07:33:00.296262 2307 tablet_bootstrap.cc:654] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.298410 2307 tablet_bootstrap.cc:492] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: No bootstrap required, opened a new log
I20260811 07:33:00.298559 2307 ts_tablet_manager.cc:1397] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 07:33:00.299196 2307 raft_consensus.cc:348] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.299357 2307 raft_consensus.cc:374] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.299388 2307 raft_consensus.cc:729] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9571ee4f3c964981a90beb34c26b0f89, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.299530 2307 consensus_queue.cc:260] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.299926 2307 ts_tablet_manager.cc:1428] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:33:00.450618 2321 raft_consensus.cc:482] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:33:00.450796 2321 raft_consensus.cc:504] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.451393 2321 leader_election.cc:288] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:33:00.452096 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd3bd83dd57f4dc199c35d437f9627ae" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99284eff4ee246a09716472c60937bb9" is_pre_election: true
I20260811 07:33:00.452179 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd3bd83dd57f4dc199c35d437f9627ae" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89" is_pre_election: true
I20260811 07:33:00.452387 2203 raft_consensus.cc:2454] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 0.
I20260811 07:33:00.452406 1810 raft_consensus.cc:2454] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 0.
I20260811 07:33:00.452829 1917 leader_election.cc:302] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 9571ee4f3c964981a90beb34c26b0f89; no voters:
I20260811 07:33:00.453150 2321 raft_consensus.cc:2781] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:33:00.453255 2321 raft_consensus.cc:482] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:33:00.453302 2321 raft_consensus.cc:3037] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.454557 2321 raft_consensus.cc:504] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.455061 2321 leader_election.cc:288] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 election: Requested vote from peers 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:33:00.455533 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd3bd83dd57f4dc199c35d437f9627ae" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89"
I20260811 07:33:00.455698 2203 raft_consensus.cc:3037] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.455773 1810 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd3bd83dd57f4dc199c35d437f9627ae" candidate_uuid: "8866c9364f7e4f7daa83bce34b5ce415" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "99284eff4ee246a09716472c60937bb9"
I20260811 07:33:00.456027 1810 raft_consensus.cc:3037] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.457010 2203 raft_consensus.cc:2454] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 1.
I20260811 07:33:00.457382 1917 leader_election.cc:302] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 9571ee4f3c964981a90beb34c26b0f89; no voters:
I20260811 07:33:00.457436 1810 raft_consensus.cc:2454] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8866c9364f7e4f7daa83bce34b5ce415 in term 1.
I20260811 07:33:00.457639 2321 raft_consensus.cc:2781] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:33:00.457835 2321 raft_consensus.cc:686] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 LEADER]: Becoming Leader. State: Replica: 8866c9364f7e4f7daa83bce34b5ce415, State: Running, Role: LEADER
I20260811 07:33:00.458002 2321 consensus_queue.cc:237] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.460317 1594 catalog_manager.cc:5495] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194). New cstate: current_term: 1 leader_uuid: "8866c9364f7e4f7daa83bce34b5ce415" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260811 07:33:00.502113 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.498297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36170 (local address 127.22.4.194:43849)
0811 07:33:00.498496 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.498500 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.498534 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:33:00.498612 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.498614 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.498681 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.498797 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:33:00.499207 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.499861 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.500903 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.501145 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.501245 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.501582 (+ 337us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.501690 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.501765 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.501893 (+ 128us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.501957 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:33:00.505247 1810 raft_consensus.cc:1261] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Refusing update from remote peer 8866c9364f7e4f7daa83bce34b5ce415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:00.505301 2203 raft_consensus.cc:1261] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Refusing update from remote peer 8866c9364f7e4f7daa83bce34b5ce415: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:00.505880 2321 consensus_queue.cc:1035] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:00.506098 2325 consensus_queue.cc:1035] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:00.515442 1593 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:33:00.515619 1593 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:33:00.518640 1593 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: Sending DeleteTablet for 3 replicas of tablet fd3bd83dd57f4dc199c35d437f9627ae
I20260811 07:33:00.519498 1781 tablet_service.cc:1514] Processing DeleteTablet for tablet fd3bd83dd57f4dc199c35d437f9627ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:46864
I20260811 07:33:00.519673 1978 tablet_service.cc:1514] Processing DeleteTablet for tablet fd3bd83dd57f4dc199c35d437f9627ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:36158
I20260811 07:33:00.519882 2345 tablet_replica.cc:330] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: stopping tablet replica
I20260811 07:33:00.519904 2181 tablet_service.cc:1514] Processing DeleteTablet for tablet fd3bd83dd57f4dc199c35d437f9627ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:54290
I20260811 07:33:00.520053 2345 raft_consensus.cc:2229] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:33:00.520156 2346 tablet_replica.cc:330] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: stopping tablet replica
I20260811 07:33:00.520241 2345 raft_consensus.cc:2258] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.520308 2346 raft_consensus.cc:2229] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:33:00.520557 2346 raft_consensus.cc:2258] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.520756 2344 tablet_replica.cc:330] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: stopping tablet replica
I20260811 07:33:00.520879 2344 raft_consensus.cc:2229] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:33:00.520828 1593 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60712:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 07:33:00.521018 2344 raft_consensus.cc:2258] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.521314 2345 ts_tablet_manager.cc:1905] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 07:33:00.521432 1593 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:33:00.521847 2344 ts_tablet_manager.cc:1905] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:00.524202 2344 ts_tablet_manager.cc:1918] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:33:00.524232 2345 ts_tablet_manager.cc:1918] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:33:00.524320 2345 log.cc:1196] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/fd3bd83dd57f4dc199c35d437f9627ae
I20260811 07:33:00.524334 2344 log.cc:1196] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/fd3bd83dd57f4dc199c35d437f9627ae
I20260811 07:33:00.524605 2345 ts_tablet_manager.cc:1939] T fd3bd83dd57f4dc199c35d437f9627ae P 99284eff4ee246a09716472c60937bb9: Deleting consensus metadata
I20260811 07:33:00.524696 2344 ts_tablet_manager.cc:1939] T fd3bd83dd57f4dc199c35d437f9627ae P 9571ee4f3c964981a90beb34c26b0f89: Deleting consensus metadata
I20260811 07:33:00.526027 2346 ts_tablet_manager.cc:1905] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:00.526369 1576 catalog_manager.cc:4841] TS 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161): tablet fd3bd83dd57f4dc199c35d437f9627ae (table test-table [id=27373f0a8b6648d0b90a9e2f31840f50]) successfully deleted
I20260811 07:33:00.527002 1575 catalog_manager.cc:4841] TS 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447): tablet fd3bd83dd57f4dc199c35d437f9627ae (table test-table [id=27373f0a8b6648d0b90a9e2f31840f50]) successfully deleted
I20260811 07:33:00.529301 2346 ts_tablet_manager.cc:1918] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:33:00.529408 2346 log.cc:1196] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/fd3bd83dd57f4dc199c35d437f9627ae
I20260811 07:33:00.529750 2346 ts_tablet_manager.cc:1939] T fd3bd83dd57f4dc199c35d437f9627ae P 8866c9364f7e4f7daa83bce34b5ce415: Deleting consensus metadata
I20260811 07:33:00.530689 1576 catalog_manager.cc:4841] TS 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849): tablet fd3bd83dd57f4dc199c35d437f9627ae (table test-table [id=27373f0a8b6648d0b90a9e2f31840f50]) successfully deleted
I20260811 07:33:00.531890 1978 tablet_service.cc:1467] Processing CreateTablet for tablet 4b2064a748d04b66b838064658e4669d (DEFAULT_TABLE table=test-table [id=665ad33416c74d818a08ef69aec5345f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:00.532208 1978 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b2064a748d04b66b838064658e4669d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.532162 2181 tablet_service.cc:1467] Processing CreateTablet for tablet 4b2064a748d04b66b838064658e4669d (DEFAULT_TABLE table=test-table [id=665ad33416c74d818a08ef69aec5345f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:00.532228 1781 tablet_service.cc:1467] Processing CreateTablet for tablet 4b2064a748d04b66b838064658e4669d (DEFAULT_TABLE table=test-table [id=665ad33416c74d818a08ef69aec5345f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:00.532446 2181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b2064a748d04b66b838064658e4669d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.532716 1781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b2064a748d04b66b838064658e4669d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:00.534945 2307 tablet_bootstrap.cc:492] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: Bootstrap starting.
I20260811 07:33:00.534996 2310 tablet_bootstrap.cc:492] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: Bootstrap starting.
I20260811 07:33:00.535908 2308 tablet_bootstrap.cc:492] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9: Bootstrap starting.
I20260811 07:33:00.535996 2307 tablet_bootstrap.cc:654] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.536212 2310 tablet_bootstrap.cc:654] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.536914 2308 tablet_bootstrap.cc:654] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:00.537751 2307 tablet_bootstrap.cc:492] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: No bootstrap required, opened a new log
I20260811 07:33:00.537864 2307 ts_tablet_manager.cc:1397] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:33:00.538281 2310 tablet_bootstrap.cc:492] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: No bootstrap required, opened a new log
I20260811 07:33:00.538344 2308 tablet_bootstrap.cc:492] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9: No bootstrap required, opened a new log
I20260811 07:33:00.538362 2310 ts_tablet_manager.cc:1397] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:33:00.538436 2308 ts_tablet_manager.cc:1397] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 07:33:00.538403 2307 raft_consensus.cc:348] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.538540 2307 raft_consensus.cc:374] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.538578 2307 raft_consensus.cc:729] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9571ee4f3c964981a90beb34c26b0f89, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.538725 2307 consensus_queue.cc:260] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.538795 2310 raft_consensus.cc:348] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.539021 2310 raft_consensus.cc:374] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.539073 2310 raft_consensus.cc:729] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8866c9364f7e4f7daa83bce34b5ce415, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.538916 2308 raft_consensus.cc:348] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.539152 2308 raft_consensus.cc:374] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:00.539198 2307 ts_tablet_manager.cc:1428] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260811 07:33:00.539249 2308 raft_consensus.cc:729] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99284eff4ee246a09716472c60937bb9, State: Initialized, Role: FOLLOWER
I20260811 07:33:00.539232 2310 consensus_queue.cc:260] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.539412 2308 consensus_queue.cc:260] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.539721 2308 ts_tablet_manager.cc:1428] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:33:00.540869 2310 ts_tablet_manager.cc:1428] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:33:00.747764 2373 raft_consensus.cc:482] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:33:00.747989 2373 raft_consensus.cc:504] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.748476 2373 leader_election.cc:288] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:33:00.749245 2007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b2064a748d04b66b838064658e4669d" candidate_uuid: "99284eff4ee246a09716472c60937bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8866c9364f7e4f7daa83bce34b5ce415" is_pre_election: true
I20260811 07:33:00.749426 2007 raft_consensus.cc:2454] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99284eff4ee246a09716472c60937bb9 in term 0.
I20260811 07:33:00.749367 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b2064a748d04b66b838064658e4669d" candidate_uuid: "99284eff4ee246a09716472c60937bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89" is_pre_election: true
I20260811 07:33:00.749729 2203 raft_consensus.cc:2454] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 99284eff4ee246a09716472c60937bb9 in term 0.
I20260811 07:33:00.749975 1718 leader_election.cc:302] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 99284eff4ee246a09716472c60937bb9; no voters:
I20260811 07:33:00.750255 2373 raft_consensus.cc:2781] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:33:00.750350 2373 raft_consensus.cc:482] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:33:00.750408 2373 raft_consensus.cc:3037] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.751869 2373 raft_consensus.cc:504] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.752331 2373 leader_election.cc:288] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [CANDIDATE]: Term 1 election: Requested vote from peers 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849), 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161)
I20260811 07:33:00.753077 2203 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b2064a748d04b66b838064658e4669d" candidate_uuid: "99284eff4ee246a09716472c60937bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9571ee4f3c964981a90beb34c26b0f89"
I20260811 07:33:00.753077 2007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b2064a748d04b66b838064658e4669d" candidate_uuid: "99284eff4ee246a09716472c60937bb9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8866c9364f7e4f7daa83bce34b5ce415"
I20260811 07:33:00.753260 2007 raft_consensus.cc:3037] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.753260 2203 raft_consensus.cc:3037] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:00.754710 2203 raft_consensus.cc:2454] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99284eff4ee246a09716472c60937bb9 in term 1.
I20260811 07:33:00.754710 2007 raft_consensus.cc:2454] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 99284eff4ee246a09716472c60937bb9 in term 1.
I20260811 07:33:00.755259 1718 leader_election.cc:302] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8866c9364f7e4f7daa83bce34b5ce415, 99284eff4ee246a09716472c60937bb9; no voters:
I20260811 07:33:00.755597 2373 raft_consensus.cc:2781] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:33:00.755882 2373 raft_consensus.cc:686] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 1 LEADER]: Becoming Leader. State: Replica: 99284eff4ee246a09716472c60937bb9, State: Running, Role: LEADER
I20260811 07:33:00.756121 2373 consensus_queue.cc:237] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } }
I20260811 07:33:00.758219 1591 catalog_manager.cc:5495] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 99284eff4ee246a09716472c60937bb9 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "99284eff4ee246a09716472c60937bb9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "99284eff4ee246a09716472c60937bb9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 36447 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 } health_report { overall_health: UNKNOWN } } }
I20260811 07:33:00.796377 2435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.791455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46880 (local address 127.22.4.193:36447)
0811 07:33:00.791755 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.791760 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.791778 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:33:00.791839 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.791842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.791905 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.792025 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:33:00.792409 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.793280 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.794519 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.794890 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.795007 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.795605 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.795711 (+ 106us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.795791 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.796126 (+ 335us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.796199 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":98,"threads_started":1}
I20260811 07:33:00.810465 2435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.805931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:34797 (local address 127.22.4.193:36447)
0811 07:33:00.806089 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:00.806094 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:00.806313 (+ 219us) server_negotiation.cc:407] Connection header received
0811 07:33:00.806423 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:00.806426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:00.806482 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:00.806594 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:33:00.807099 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.807910 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.808978 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.809361 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.809474 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.809823 (+ 349us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.809914 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.809991 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:00.810193 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 07:33:00.810272 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":28,"server-negotiator.queue_time_us":65}
I20260811 07:33:00.810492 2440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.805814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36447 (local address 127.22.4.193:34797)
0811 07:33:00.806196 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:00.806211 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:00.806329 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:00.806622 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:00.806624 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:00.806632 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 07:33:00.806965 (+ 333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.806973 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.808064 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.808068 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.808839 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:00.808850 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:00.809506 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:00.809509 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:00.809639 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:00.809680 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 07:33:00.810063 (+ 383us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 07:33:00.810072 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:33:00.810157 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:33:00.810263 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"thread_start_us":153,"threads_started":1}
I20260811 07:33:00.820468 2203 raft_consensus.cc:1261] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Refusing update from remote peer 99284eff4ee246a09716472c60937bb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:00.820678 2007 raft_consensus.cc:1261] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Refusing update from remote peer 99284eff4ee246a09716472c60937bb9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:00.821091 2434 consensus_queue.cc:1035] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9571ee4f3c964981a90beb34c26b0f89" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:00.821281 2373 consensus_queue.cc:1035] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8866c9364f7e4f7daa83bce34b5ce415" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 43849 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:00.874960 1591 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:33:00.875231 1591 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60712:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:33:00.878429 1591 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4f994441f684500b69ec316afc2ff9e: Sending DeleteTablet for 3 replicas of tablet 4b2064a748d04b66b838064658e4669d
I20260811 07:33:00.879410 1978 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b2064a748d04b66b838064658e4669d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:36158
I20260811 07:33:00.879442 1781 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b2064a748d04b66b838064658e4669d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:46864
I20260811 07:33:00.879686 2181 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b2064a748d04b66b838064658e4669d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:00 UTC) from {username='oryx', principal='oryx/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:54290
I20260811 07:33:00.879804 2345 tablet_replica.cc:330] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9: stopping tablet replica
I20260811 07:33:00.879918 2346 tablet_replica.cc:330] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: stopping tablet replica
I20260811 07:33:00.879961 2345 raft_consensus.cc:2229] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:33:00.880052 2346 raft_consensus.cc:2229] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:33:00.880183 2346 raft_consensus.cc:2258] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.880352 2344 tablet_replica.cc:330] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: stopping tablet replica
I20260811 07:33:00.880407 2345 raft_consensus.cc:2258] T 4b2064a748d04b66b838064658e4669d P 99284eff4ee246a09716472c60937bb9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.880466 2344 raft_consensus.cc:2229] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:33:00.880574 2344 raft_consensus.cc:2258] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:00.880808 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 1694
I20260811 07:33:00.886222 2344 ts_tablet_manager.cc:1905] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:00.886222 2346 ts_tablet_manager.cc:1905] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:00.889158 2346 ts_tablet_manager.cc:1918] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:33:00.889158 2344 ts_tablet_manager.cc:1918] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 07:33:00.889257 2346 log.cc:1196] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/4b2064a748d04b66b838064658e4669d
I20260811 07:33:00.889257 2344 log.cc:1196] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/4b2064a748d04b66b838064658e4669d
I20260811 07:33:00.889557 2346 ts_tablet_manager.cc:1939] T 4b2064a748d04b66b838064658e4669d P 8866c9364f7e4f7daa83bce34b5ce415: Deleting consensus metadata
I20260811 07:33:00.889557 2344 ts_tablet_manager.cc:1939] T 4b2064a748d04b66b838064658e4669d P 9571ee4f3c964981a90beb34c26b0f89: Deleting consensus metadata
I20260811 07:33:00.890681 1576 catalog_manager.cc:4841] TS 8866c9364f7e4f7daa83bce34b5ce415 (127.22.4.194:43849): tablet 4b2064a748d04b66b838064658e4669d (table test-table [id=665ad33416c74d818a08ef69aec5345f]) successfully deleted
I20260811 07:33:00.892575 1576 catalog_manager.cc:4841] TS 9571ee4f3c964981a90beb34c26b0f89 (127.22.4.195:38161): tablet 4b2064a748d04b66b838064658e4669d (table test-table [id=665ad33416c74d818a08ef69aec5345f]) successfully deleted
W20260811 07:33:00.903069 1575 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:36447 (error 108)
I20260811 07:33:00.903877 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 1889
I20260811 07:33:00.913455 2448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:00.904144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:36447 (local address 127.0.0.1:46882)
0811 07:33:00.913153 (+ 9009us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:00.913285 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8852,"thread_start_us":74,"threads_started":1}
W20260811 07:33:00.915786 1575 catalog_manager.cc:4584] TS 99284eff4ee246a09716472c60937bb9 (127.22.4.193:36447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4b2064a748d04b66b838064658e4669d: Network error: Client connection negotiation failed: client connection to 127.22.4.193:36447: connect: Connection refused (error 111)
I20260811 07:33:00.924249 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 2084
I20260811 07:33:00.955083 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 1545
2026-08-11T07:33:00Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (4386 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:33:01 dist-test-slave-7z32 krb5kdc[2451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:33:01 dist-test-slave-7z32 krb5kdc[2451](info): set up 2 sockets
Aug 11 07:33:01 dist-test-slave-7z32 krb5kdc[2451](info): commencing operation
krb5kdc: starting...
W20260811 07:33:02.377846 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.388s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:33:02 dist-test-slave-7z32 krb5kdc[2451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433582, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:33:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:33:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:33:02.559327 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:32895
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36663
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:32895
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:02.726511 2476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:02.726997 2476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:02.727111 2476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:02.731863 2476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:33:02.732004 2476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:02.732041 2476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:02.732082 2476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:33:02.732151 2476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:33:02.739094 2476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36663
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:32895
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:32895
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:02.740849 2476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:02.742285 2476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:02.755088 2485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:02.755064 2484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:02.755064 2490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:02.755257 2476 server_base.cc:1034] running on GCE node
I20260811 07:33:02.756273 2476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:02.758018 2476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:02.759361 2476 hybrid_clock.cc:648] HybridClock initialized: now 1786433582759325 us; error 107 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T07:33:02Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1809 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:33:02 dist-test-slave-7z32 krb5kdc[2496](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:33:02 dist-test-slave-7z32 krb5kdc[2496](info): set up 2 sockets
Aug 11 07:33:02 dist-test-slave-7z32 krb5kdc[2496](info): commencing operation
krb5kdc: starting...
W20260811 07:33:04.147469 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.347s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:33:04 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:33:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:33:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:33:04.324070 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38671
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:38671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:04.494014 2513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:04.494499 2513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:04.494593 2513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:04.499732 2513 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:33:04.499930 2513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:04.499974 2513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:04.500005 2513 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:33:04.500046 2513 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:33:04.508273 2513 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:38671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:04.510058 2513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:04.511885 2513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:04.524717 2523 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:04.524765 2525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:04.524739 2518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:04.525357 2513 server_base.cc:1034] running on GCE node
I20260811 07:33:04.526216 2513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:04.527927 2513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:04.529215 2513 hybrid_clock.cc:648] HybridClock initialized: now 1786433584529176 us; error 61 us; skew 500 ppm
Aug 11 07:33:04 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433584, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:04.539081 2513 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:33:04.540966 2513 webserver.cc:460] Webserver started at http://127.22.4.254:34235/ using document root <none> and password file <none>
I20260811 07:33:04.541774 2513 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:04.541857 2513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:04.542100 2513 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:04.545140 2513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "b13aa51a82304b9fa85a8748b3e8b425"
format_stamp: "Formatted at 2026-08-11 07:33:04 on dist-test-slave-7z32"
server_key: "bd51997be7dd6b17e0eca5bfe461f1fe"
server_key_iv: "200c5ba8715063d74a64ae2115021387"
server_key_version: "encryptionkey@0"
I20260811 07:33:04.545945 2513 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "b13aa51a82304b9fa85a8748b3e8b425"
format_stamp: "Formatted at 2026-08-11 07:33:04 on dist-test-slave-7z32"
server_key: "bd51997be7dd6b17e0eca5bfe461f1fe"
server_key_iv: "200c5ba8715063d74a64ae2115021387"
server_key_version: "encryptionkey@0"
I20260811 07:33:04.552489 2513 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 07:33:04.556770 2536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:04.559152 2513 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.004s
I20260811 07:33:04.559504 2513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b13aa51a82304b9fa85a8748b3e8b425"
format_stamp: "Formatted at 2026-08-11 07:33:04 on dist-test-slave-7z32"
server_key: "bd51997be7dd6b17e0eca5bfe461f1fe"
server_key_iv: "200c5ba8715063d74a64ae2115021387"
server_key_version: "encryptionkey@0"
I20260811 07:33:04.559716 2513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:04.585421 2513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:04.591464 2513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:04.591786 2513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:04.604303 2513 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:38671
I20260811 07:33:04.604387 2611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:38671 every 8 connection(s)
I20260811 07:33:04.605623 2513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:33:04.607535 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 2513
I20260811 07:33:04.607738 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:33:04.608112 22547 external_mini_cluster.cc:1428] Setting key 977bb351cdf7413dcac68f95ce4bdbd4
I20260811 07:33:04.610504 2612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:04.619834 2612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Bootstrap starting.
Aug 11 07:33:04 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433584, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:33:04.623150 2612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:04.624132 2612 log.cc:824] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Log is configured to *not* fsync() on all Append() calls
I20260811 07:33:04.627720 2612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: No bootstrap required, opened a new log
I20260811 07:33:04.632328 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:04.609991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53786 (local address 127.22.4.254:38671)
0811 07:33:04.611018 (+ 1027us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:04.611044 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:04.611103 (+ 59us) server_negotiation.cc:407] Connection header received
0811 07:33:04.611958 (+ 855us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:04.611982 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:04.612680 (+ 698us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:04.613226 (+ 546us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:04.615217 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:04.617046 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:04.618126 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:04.619330 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:04.619623 (+ 293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:04.622890 (+ 3267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:04.622900 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:04.622929 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:04.622986 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:04.626334 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:04.627221 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:04.627229 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:04.627235 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:04.627432 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:04.628135 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:04.628141 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:04.628142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:04.628962 (+ 820us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:04.629348 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:04.629920 (+ 572us) server_negotiation.cc:299] Negotiation successful
0811 07:33:04.630483 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":274,"threads_started":1}
I20260811 07:33:04.633217 2612 raft_consensus.cc:348] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } }
I20260811 07:33:04.633630 2612 raft_consensus.cc:374] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:04.633744 2612 raft_consensus.cc:729] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13aa51a82304b9fa85a8748b3e8b425, State: Initialized, Role: FOLLOWER
I20260811 07:33:04.634418 2612 consensus_queue.cc:260] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } }
I20260811 07:33:04.634642 2612 raft_consensus.cc:388] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:33:04.634721 2612 raft_consensus.cc:482] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:33:04.634859 2612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:04.636564 2612 raft_consensus.cc:504] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } }
I20260811 07:33:04.637027 2612 leader_election.cc:302] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b13aa51a82304b9fa85a8748b3e8b425; no voters:
I20260811 07:33:04.637427 2612 leader_election.cc:288] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:33:04.637777 2618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:33:04.638302 2618 raft_consensus.cc:686] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 1 LEADER]: Becoming Leader. State: Replica: b13aa51a82304b9fa85a8748b3e8b425, State: Running, Role: LEADER
I20260811 07:33:04.638939 2618 consensus_queue.cc:237] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } }
I20260811 07:33:04.639345 2612 sys_catalog.cc:564] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:33:04.641530 2619 sys_catalog.cc:455] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b13aa51a82304b9fa85a8748b3e8b425" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } } }
I20260811 07:33:04.641829 2619 sys_catalog.cc:458] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:04.642238 2620 sys_catalog.cc:455] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b13aa51a82304b9fa85a8748b3e8b425. Latest consensus state: current_term: 1 leader_uuid: "b13aa51a82304b9fa85a8748b3e8b425" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } } }
I20260811 07:33:04.642709 2637 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:33:04.643014 2620 sys_catalog.cc:458] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:04.646952 2637 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:33:04.655958 2637 catalog_manager.cc:1347] Generated new cluster ID: d16427dc756e4bdca6b529ebe77e3782
I20260811 07:33:04.656225 2637 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:33:04.683156 2637 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:33:04.684309 2637 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:33:04.695351 2637 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Generated new TSK 0
I20260811 07:33:04.696373 2637 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:33:04.756016 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38671
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:04.942888 2649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:04.943254 2649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:04.943310 2649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:04.947856 2649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:04.947938 2649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:04.948005 2649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:33:04.953908 2649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:04.955386 2649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:04.956610 2649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:04.968865 2660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:04.968892 2655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:04.968935 2654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:04.969521 2649 server_base.cc:1034] running on GCE node
I20260811 07:33:04.970075 2649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:04.971015 2649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:04.974493 2649 hybrid_clock.cc:648] HybridClock initialized: now 1786433584974477 us; error 177 us; skew 500 ppm
Aug 11 07:33:04 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433584, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:04.978623 2649 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:33:04.980639 2649 webserver.cc:460] Webserver started at http://127.22.4.193:40637/ using document root <none> and password file <none>
I20260811 07:33:04.981763 2649 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:04.981878 2649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:04.982180 2649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:04.984884 2649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "7d79599a37b74714947a14ad6e42bfbc"
format_stamp: "Formatted at 2026-08-11 07:33:04 on dist-test-slave-7z32"
server_key: "14788d9f82359b4b14f48373a7b7b1fd"
server_key_iv: "2e311f3bf2a4b6e2f7b3806f75100ea0"
server_key_version: "encryptionkey@0"
I20260811 07:33:04.985591 2649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "7d79599a37b74714947a14ad6e42bfbc"
format_stamp: "Formatted at 2026-08-11 07:33:04 on dist-test-slave-7z32"
server_key: "14788d9f82359b4b14f48373a7b7b1fd"
server_key_iv: "2e311f3bf2a4b6e2f7b3806f75100ea0"
server_key_version: "encryptionkey@0"
I20260811 07:33:04.991722 2649 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 07:33:04.995906 2668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:04.997931 2649 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:33:04.998116 2649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "7d79599a37b74714947a14ad6e42bfbc"
format_stamp: "Formatted at 2026-08-11 07:33:04 on dist-test-slave-7z32"
server_key: "14788d9f82359b4b14f48373a7b7b1fd"
server_key_iv: "2e311f3bf2a4b6e2f7b3806f75100ea0"
server_key_version: "encryptionkey@0"
I20260811 07:33:04.998347 2649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:05.012491 2649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:05.016701 2649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:05.016995 2649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:05.017741 2649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:05.018787 2649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:05.018916 2649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:05.018971 2649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:05.018987 2649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:05.032895 2649 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:37169
I20260811 07:33:05.032951 2821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:37169 every 8 connection(s)
I20260811 07:33:05.034196 2649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:33:05.040429 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 2649
I20260811 07:33:05.040660 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:33:05.041052 22547 external_mini_cluster.cc:1428] Setting key 3e52a7b5a81fb1613edea9598d9d9bd7
Aug 11 07:33:05 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433584, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:33:05.056618 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:05.037235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:56713 (local address 127.22.4.254:38671)
0811 07:33:05.037509 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:05.037516 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:05.038901 (+ 1385us) server_negotiation.cc:407] Connection header received
0811 07:33:05.041869 (+ 2968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:05.041876 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:05.041976 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:05.042096 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:05.044198 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.044812 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.046413 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.046723 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.046972 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:05.051309 (+ 4337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:05.051313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:05.051315 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:05.051349 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:05.053254 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:05.054283 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:05.054286 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:05.054288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:05.054396 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:05.054862 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:05.054878 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:05.054880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:05.055164 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:05.055290 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:05.056233 (+ 943us) server_negotiation.cc:299] Negotiation successful
0811 07:33:05.056421 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260811 07:33:05.057673 2824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:05.037668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:56713)
0811 07:33:05.038465 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:05.038587 (+ 122us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:05.041358 (+ 2771us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:05.042507 (+ 1149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:05.042519 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:05.043153 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:05.043995 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:05.044016 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.044976 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.044982 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:05.046203 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:05.046231 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.047080 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.047088 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:05.047374 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:05.048329 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:05.048363 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:05.051023 (+ 2660us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:05.053532 (+ 2509us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:05.053542 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:05.053569 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:05.054122 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:05.054521 (+ 399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:05.054525 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:05.054527 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:05.054719 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:05.055366 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:05.055374 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:05.055804 (+ 430us) client_negotiation.cc:769] Sending connection context
0811 07:33:05.056097 (+ 293us) client_negotiation.cc:240] Negotiation successful
0811 07:33:05.056532 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":188,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:33:05.060038 2822 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38671
I20260811 07:33:05.060537 2822 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:05.061609 2822 heartbeater.cc:511] Master 127.22.4.254:38671 requested a full tablet report, sending...
I20260811 07:33:05.064371 2555 ts_manager.cc:194] Registered new tserver with Master: 7d79599a37b74714947a14ad6e42bfbc (127.22.4.193:37169)
I20260811 07:33:05.065820 2555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:56713
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:33:05.088701 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38671
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:05.255206 2827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:05.255685 2827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:05.255776 2827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:05.260736 2827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:05.260877 2827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:05.260996 2827 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:33:05.268071 2827 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2827
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:05.269800 2827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:05.271307 2827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:05.286113 2832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:05.286113 2833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:05.286203 2838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:05.286410 2827 server_base.cc:1034] running on GCE node
I20260811 07:33:05.287168 2827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:05.288132 2827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:05.289414 2827 hybrid_clock.cc:648] HybridClock initialized: now 1786433585289361 us; error 71 us; skew 500 ppm
Aug 11 07:33:05 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433585, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:05.293843 2827 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:33:05.295595 2827 webserver.cc:460] Webserver started at http://127.22.4.194:41873/ using document root <none> and password file <none>
I20260811 07:33:05.296679 2827 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:05.296833 2827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:05.297183 2827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:05.300755 2827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "be588e2b7bc44f98adef1b4afea6db64"
format_stamp: "Formatted at 2026-08-11 07:33:05 on dist-test-slave-7z32"
server_key: "e831ee0e44a44305fec9d0ca507e1ab5"
server_key_iv: "5444b5c14f90eb1bb196714b23091748"
server_key_version: "encryptionkey@0"
I20260811 07:33:05.301677 2827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "be588e2b7bc44f98adef1b4afea6db64"
format_stamp: "Formatted at 2026-08-11 07:33:05 on dist-test-slave-7z32"
server_key: "e831ee0e44a44305fec9d0ca507e1ab5"
server_key_iv: "5444b5c14f90eb1bb196714b23091748"
server_key_version: "encryptionkey@0"
I20260811 07:33:05.308255 2827 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:33:05.312885 2851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:05.315340 2827 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:33:05.315591 2827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "be588e2b7bc44f98adef1b4afea6db64"
format_stamp: "Formatted at 2026-08-11 07:33:05 on dist-test-slave-7z32"
server_key: "e831ee0e44a44305fec9d0ca507e1ab5"
server_key_iv: "5444b5c14f90eb1bb196714b23091748"
server_key_version: "encryptionkey@0"
I20260811 07:33:05.315784 2827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:05.350073 2827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:05.355167 2827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:05.355463 2827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:05.356527 2827 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:05.358059 2827 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:05.358204 2827 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:05.358363 2827 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:05.358426 2827 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:05.374084 2827 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:32839
I20260811 07:33:05.374105 3023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:32839 every 8 connection(s)
I20260811 07:33:05.375537 2827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:33:05.383150 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 2827
I20260811 07:33:05.383420 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:33:05.383797 22547 external_mini_cluster.cc:1428] Setting key c21bc4246e8e692fd4e3fae07a54309f
Aug 11 07:33:05 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433585, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:33:05.397541 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:05.378232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:33661 (local address 127.22.4.254:38671)
0811 07:33:05.378459 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:05.378465 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:05.379525 (+ 1060us) server_negotiation.cc:407] Connection header received
0811 07:33:05.381453 (+ 1928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:05.381457 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:05.381544 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:05.381641 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:05.383543 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.384345 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.386402 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.386811 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.386999 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:05.391059 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:05.391063 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:05.391066 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:05.391107 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:05.393615 (+ 2508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:05.394792 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:05.394796 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:05.394797 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:05.395024 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:05.395717 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:05.395721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:05.395722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:05.395999 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:05.396095 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:05.397216 (+ 1121us) server_negotiation.cc:299] Negotiation successful
0811 07:33:05.397386 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:33:05.399458 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:05.378610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:33661)
0811 07:33:05.379290 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:05.379357 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:05.381122 (+ 1765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:05.381899 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:05.381908 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:05.382473 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:05.383250 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:05.383270 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.384592 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.384597 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:05.386216 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:05.386229 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.387059 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.387062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:05.387275 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:05.388194 (+ 919us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:05.388216 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:05.390661 (+ 2445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:05.393867 (+ 3206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:05.393883 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:05.393919 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:05.394565 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:05.395175 (+ 610us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:05.395183 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:05.395188 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:05.395506 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:05.396205 (+ 699us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:05.396216 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:05.396796 (+ 580us) client_negotiation.cc:769] Sending connection context
0811 07:33:05.397131 (+ 335us) client_negotiation.cc:240] Negotiation successful
0811 07:33:05.397696 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":379,"thread_start_us":202,"threads_started":1}
I20260811 07:33:05.401813 3024 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38671
I20260811 07:33:05.402271 3024 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:05.403152 3024 heartbeater.cc:511] Master 127.22.4.254:38671 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:33:05.405223 2555 ts_manager.cc:194] Registered new tserver with Master: be588e2b7bc44f98adef1b4afea6db64 (127.22.4.194:32839)
I20260811 07:33:05.406155 2555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:33661
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:33:05.431519 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38671
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:05.605088 3034 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:05.605522 3034 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:05.605592 3034 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:05.612908 3034 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:05.613039 3034 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:05.613142 3034 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:33:05.623263 3034 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:05.625041 3034 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:05.627437 3034 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:05.643045 3039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:05.643051 3041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:05.643051 3044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:05.643966 3034 server_base.cc:1034] running on GCE node
I20260811 07:33:05.644644 3034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:05.645635 3034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:05.647156 3034 hybrid_clock.cc:648] HybridClock initialized: now 1786433585647088 us; error 85 us; skew 500 ppm
Aug 11 07:33:05 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433585, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:05.651535 3034 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:33:05.653258 3034 webserver.cc:460] Webserver started at http://127.22.4.195:37639/ using document root <none> and password file <none>
I20260811 07:33:05.654179 3034 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:05.654311 3034 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:05.654642 3034 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:05.657945 3034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "10123ae66426441c99477e83a1c8a96b"
format_stamp: "Formatted at 2026-08-11 07:33:05 on dist-test-slave-7z32"
server_key: "19564b92d6e0fd7170e5fa00c1e5b782"
server_key_iv: "c75f1a33b8ad316739e68dc75e2a414c"
server_key_version: "encryptionkey@0"
I20260811 07:33:05.659065 3034 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "10123ae66426441c99477e83a1c8a96b"
format_stamp: "Formatted at 2026-08-11 07:33:05 on dist-test-slave-7z32"
server_key: "19564b92d6e0fd7170e5fa00c1e5b782"
server_key_iv: "c75f1a33b8ad316739e68dc75e2a414c"
server_key_version: "encryptionkey@0"
I20260811 07:33:05.666126 3034 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:33:05.670284 3053 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:05.672412 3034 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:33:05.672724 3034 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "10123ae66426441c99477e83a1c8a96b"
format_stamp: "Formatted at 2026-08-11 07:33:05 on dist-test-slave-7z32"
server_key: "19564b92d6e0fd7170e5fa00c1e5b782"
server_key_iv: "c75f1a33b8ad316739e68dc75e2a414c"
server_key_version: "encryptionkey@0"
I20260811 07:33:05.672940 3034 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:05.694676 3034 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:05.701609 3034 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:05.701972 3034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:05.703246 3034 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:05.704624 3034 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:05.704718 3034 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:05.704807 3034 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:05.704856 3034 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:05.720055 3034 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:45057
I20260811 07:33:05.720055 3210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:45057 every 8 connection(s)
I20260811 07:33:05.721720 3034 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:33:05.724045 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 3034
I20260811 07:33:05.724277 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:33:05.724805 22547 external_mini_cluster.cc:1428] Setting key 337c61b8fccad75b5acfd02aebcf9da8
Aug 11 07:33:05 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433585, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:33:05.743741 2615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:05.725207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:60617 (local address 127.22.4.254:38671)
0811 07:33:05.725402 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:05.725406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:05.726879 (+ 1473us) server_negotiation.cc:407] Connection header received
0811 07:33:05.729049 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:05.729053 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:05.729132 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:05.729212 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:05.731198 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.731844 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.733762 (+ 1918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.734043 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.734184 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:05.738529 (+ 4345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:05.738534 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:05.738536 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:05.738579 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:05.740504 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:05.741403 (+ 899us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:05.741411 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:05.741414 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:05.741519 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:05.742021 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:05.742025 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:05.742027 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:05.742293 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:05.742417 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:05.743339 (+ 922us) server_negotiation.cc:299] Negotiation successful
0811 07:33:05.743524 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:33:05.745407 3214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:05.725788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:60617)
0811 07:33:05.726585 (+ 797us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:05.726666 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:05.728751 (+ 2085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:05.729499 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:05.729514 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:05.730171 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:05.730988 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:05.731010 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.732024 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.732028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:05.733536 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:05.733554 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:05.734270 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:05.734275 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:05.734529 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:05.735615 (+ 1086us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:05.735642 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:05.738167 (+ 2525us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:05.740695 (+ 2528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:05.740706 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:05.740757 (+ 51us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:05.741251 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:05.741630 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:05.741633 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:05.741636 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:05.741896 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:05.742462 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:05.742472 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:05.742961 (+ 489us) client_negotiation.cc:769] Sending connection context
0811 07:33:05.743275 (+ 314us) client_negotiation.cc:240] Negotiation successful
0811 07:33:05.743777 (+ 502us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":182,"threads_started":1}
I20260811 07:33:05.747821 3211 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38671
I20260811 07:33:05.748261 3211 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:05.749300 3211 heartbeater.cc:511] Master 127.22.4.254:38671 requested a full tablet report, sending...
I20260811 07:33:05.751389 2555 ts_manager.cc:194] Registered new tserver with Master: 10123ae66426441c99477e83a1c8a96b (127.22.4.195:45057)
I20260811 07:33:05.752092 2555 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:60617
I20260811 07:33:05.756110 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab.
Entry for principal oryx/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab.
WARNING: no policy specified for oryx/127.22.4.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab.
Entry for principal oryx/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab.
WARNING: no policy specified for oryx/127.22.4.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.22.4.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab.
Entry for principal oryx/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab.
I20260811 07:33:05.888110 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 2649
I20260811 07:33:05.919274 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 2827
I20260811 07:33:05.949586 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 3034
I20260811 07:33:05.964187 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 2513
I20260811 07:33:05.991300 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38671
--webserver_interface=127.22.4.254
--webserver_port=34235
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:38671
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:06.157126 3222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:06.157588 3222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:06.157680 3222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:06.162346 3222 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:33:06.162488 3222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:06.162525 3222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:06.162564 3222 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:33:06.162618 3222 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:33:06.169713 3222 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:38671
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=34235
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:06.171489 3222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:06.172955 3222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:06.186712 3229 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:06.186683 3232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:06.186815 3222 server_base.cc:1034] running on GCE node
W20260811 07:33:06.186690 3230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:06.187981 3222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:06.189736 3222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:06.193256 3222 hybrid_clock.cc:648] HybridClock initialized: now 1786433586193194 us; error 88 us; skew 500 ppm
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433586, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:06.197723 3222 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:33:06.199556 3222 webserver.cc:460] Webserver started at http://127.22.4.254:34235/ using document root <none> and password file <none>
I20260811 07:33:06.200518 3222 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:06.200981 3222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:06.207883 3222 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:33:06.212255 3242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:06.215338 3222 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.006s sys 0.000s
I20260811 07:33:06.215583 3222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b13aa51a82304b9fa85a8748b3e8b425"
format_stamp: "Formatted at 2026-08-11 07:33:04 on dist-test-slave-7z32"
server_key: "bd51997be7dd6b17e0eca5bfe461f1fe"
server_key_iv: "200c5ba8715063d74a64ae2115021387"
server_key_version: "encryptionkey@0"
I20260811 07:33:06.216337 3222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:06.237242 3222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:06.241868 3222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:06.242152 3222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:06.253563 3222 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:38671
I20260811 07:33:06.253666 3319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:38671 every 8 connection(s)
I20260811 07:33:06.255177 3222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:33:06.261785 3320 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:33:06.264896 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 3222
I20260811 07:33:06.265053 3320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Bootstrap starting.
I20260811 07:33:06.265530 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:37169
--local_ip_for_outbound_sockets=127.22.4.193
--tserver_master_addrs=127.22.4.254:38671
--webserver_port=40637
--webserver_interface=127.22.4.193
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.4.193
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:33:06.295921 3320 log.cc:824] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Log is configured to *not* fsync() on all Append() calls
I20260811 07:33:06.308068 3320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:33:06.308782 3320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Bootstrap complete.
I20260811 07:33:06.314589 3320 raft_consensus.cc:348] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } }
I20260811 07:33:06.315339 3320 raft_consensus.cc:729] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13aa51a82304b9fa85a8748b3e8b425, State: Initialized, Role: FOLLOWER
I20260811 07:33:06.316304 3320 consensus_queue.cc:260] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } }
I20260811 07:33:06.316527 3320 raft_consensus.cc:388] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:33:06.316735 3320 raft_consensus.cc:482] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:33:06.316887 3320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:33:06.320070 3320 raft_consensus.cc:504] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } }
I20260811 07:33:06.320684 3320 leader_election.cc:302] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b13aa51a82304b9fa85a8748b3e8b425; no voters:
I20260811 07:33:06.321211 3320 leader_election.cc:288] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:33:06.321347 3327 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:33:06.321587 3327 raft_consensus.cc:686] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [term 2 LEADER]: Becoming Leader. State: Replica: b13aa51a82304b9fa85a8748b3e8b425, State: Running, Role: LEADER
I20260811 07:33:06.322067 3327 consensus_queue.cc:237] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } }
I20260811 07:33:06.323071 3320 sys_catalog.cc:564] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:33:06.323576 3329 sys_catalog.cc:455] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b13aa51a82304b9fa85a8748b3e8b425. Latest consensus state: current_term: 2 leader_uuid: "b13aa51a82304b9fa85a8748b3e8b425" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } } }
I20260811 07:33:06.323506 3328 sys_catalog.cc:455] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b13aa51a82304b9fa85a8748b3e8b425" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b13aa51a82304b9fa85a8748b3e8b425" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38671 } } }
I20260811 07:33:06.323738 3329 sys_catalog.cc:458] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:06.323745 3328 sys_catalog.cc:458] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425 [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:06.324301 3332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:33:06.329250 3332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:33:06.330124 3332 catalog_manager.cc:1259] Loaded cluster ID: d16427dc756e4bdca6b529ebe77e3782
I20260811 07:33:06.330253 3332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:33:06.333240 3332 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:33:06.334275 3332 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b13aa51a82304b9fa85a8748b3e8b425: Loaded TSK: 0
I20260811 07:33:06.336015 3332 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:33:06.440349 3324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:06.440734 3324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:06.440812 3324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:06.445257 3324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:06.445396 3324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:06.445502 3324 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:33:06.451838 3324 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.193.keytab
--principal=oryx/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:37169
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=40637
--tserver_master_addrs=127.22.4.254:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:06.453195 3324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:06.454428 3324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:06.469002 3362 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:06.469014 3363 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:06.469162 3366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:06.470371 3324 server_base.cc:1034] running on GCE node
I20260811 07:33:06.471041 3324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:06.471931 3324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:06.475353 3324 hybrid_clock.cc:648] HybridClock initialized: now 1786433586475306 us; error 65 us; skew 500 ppm
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433586, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:06.479209 3324 init.cc:377] Logged in from keytab as oryx/127.22.4.193@KRBTEST.COM (short username oryx)
I20260811 07:33:06.480662 3324 webserver.cc:460] Webserver started at http://127.22.4.193:40637/ using document root <none> and password file <none>
I20260811 07:33:06.481431 3324 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:06.481598 3324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:06.487318 3324 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:33:06.490878 3376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:06.492887 3324 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:33:06.493142 3324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "7d79599a37b74714947a14ad6e42bfbc"
format_stamp: "Formatted at 2026-08-11 07:33:04 on dist-test-slave-7z32"
server_key: "14788d9f82359b4b14f48373a7b7b1fd"
server_key_iv: "2e311f3bf2a4b6e2f7b3806f75100ea0"
server_key_version: "encryptionkey@0"
I20260811 07:33:06.493845 3324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:06.538805 3324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:06.544919 3324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:06.545220 3324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:06.545965 3324 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:06.547137 3324 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:06.547217 3324 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:06.547302 3324 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:06.547348 3324 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:06.563593 3324 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:37169
I20260811 07:33:06.563791 3556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:37169 every 8 connection(s)
I20260811 07:33:06.565244 3324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:33:06.571554 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 3324
I20260811 07:33:06.572435 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:32839
--local_ip_for_outbound_sockets=127.22.4.194
--tserver_master_addrs=127.22.4.254:38671
--webserver_port=41873
--webserver_interface=127.22.4.194
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.4.194
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:33:06.603199 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:06.569444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:55929 (local address 127.22.4.254:38671)
0811 07:33:06.570578 (+ 1134us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:06.570605 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:06.571398 (+ 793us) server_negotiation.cc:407] Connection header received
0811 07:33:06.574755 (+ 3357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:06.574775 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:06.576331 (+ 1556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:06.577707 (+ 1376us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:06.584496 (+ 6789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.586794 (+ 2298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.590233 (+ 3439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.591664 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.592167 (+ 503us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.600275 (+ 8108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:55929: BlockingRecv error: recv got EOF from 127.22.4.193:55929 (error 108)
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":195,"threads_started":1}
I20260811 07:33:06.603227 3560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:06.569595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:55929)
0811 07:33:06.571027 (+ 1432us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:06.571153 (+ 126us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:06.573888 (+ 2735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:06.578060 (+ 4172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:06.578074 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:06.579051 (+ 977us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:06.580197 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.580253 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.587447 (+ 7194us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.587458 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.589760 (+ 2302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.589805 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.592061 (+ 2256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.592072 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.592723 (+ 651us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.594333 (+ 1610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:06.594369 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:06.599078 (+ 4709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":819,"thread_start_us":561,"threads_started":1}
W20260811 07:33:06.604692 3557 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:38671 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.4.254:38671: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:06.615787 3560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:06.605425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:46385)
0811 07:33:06.605745 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:06.605760 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:06.605858 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:06.606411 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:06.606415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:06.606687 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:06.607445 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.607459 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.609604 (+ 2145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.609609 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.610582 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.610604 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.611572 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.611576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.611670 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.612417 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:06.612431 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:06.615643 (+ 3212us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":108}
W20260811 07:33:06.616426 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:06.605488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:46385 (local address 127.22.4.254:38671)
0811 07:33:06.605898 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:06.605906 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:06.605943 (+ 37us) server_negotiation.cc:407] Connection header received
0811 07:33:06.606033 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:06.606037 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:06.606133 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:06.606308 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:06.607818 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.609298 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.610885 (+ 1587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.611316 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.611490 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.616040 (+ 4550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:46385: BlockingRecv error: recv got EOF from 127.22.4.193:46385 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:33:06.629200 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:06.617867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:33545 (local address 127.22.4.254:38671)
0811 07:33:06.618082 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:06.618093 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:06.618108 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:33:06.618160 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:06.618163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:06.618214 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:06.618323 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:06.619298 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.620581 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.621536 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.621843 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.622006 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.629048 (+ 7042us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:33545: BlockingRecv error: recv got EOF from 127.22.4.193:33545 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:33:06.629621 3560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:06.617636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:33545)
0811 07:33:06.617814 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:06.617833 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:06.617969 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:06.618336 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:06.618339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:06.619019 (+ 680us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:06.619137 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.619145 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.620758 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.620763 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.621365 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.621376 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.622496 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.622504 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.622669 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.624972 (+ 2303us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:06.624995 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:06.629036 (+ 4041us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":90}
W20260811 07:33:06.630165 3557 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:33:06.770184 3563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:06.770643 3563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:06.770700 3563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:06.776345 3563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:06.776535 3563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:06.776614 3563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:33:06.785809 3563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.194.keytab
--principal=oryx/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:32839
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=41873
--tserver_master_addrs=127.22.4.254:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:06.787963 3563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:06.789676 3563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:06.805544 3571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:06.805603 3570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:06.805544 3573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:06.806376 3563 server_base.cc:1034] running on GCE node
I20260811 07:33:06.807168 3563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:06.808176 3563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:06.809722 3563 hybrid_clock.cc:648] HybridClock initialized: now 1786433586809661 us; error 79 us; skew 500 ppm
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433586, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:06.814625 3563 init.cc:377] Logged in from keytab as oryx/127.22.4.194@KRBTEST.COM (short username oryx)
I20260811 07:33:06.816726 3563 webserver.cc:460] Webserver started at http://127.22.4.194:41873/ using document root <none> and password file <none>
I20260811 07:33:06.817519 3563 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:06.817632 3563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:06.826321 3563 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:33:06.831236 3583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:06.834551 3563 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.002s
I20260811 07:33:06.834770 3563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "be588e2b7bc44f98adef1b4afea6db64"
format_stamp: "Formatted at 2026-08-11 07:33:05 on dist-test-slave-7z32"
server_key: "e831ee0e44a44305fec9d0ca507e1ab5"
server_key_iv: "5444b5c14f90eb1bb196714b23091748"
server_key_version: "encryptionkey@0"
I20260811 07:33:06.835636 3563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:06.860476 3563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:06.866245 3563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:06.866580 3563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:06.867463 3563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:06.868597 3563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:06.868659 3563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:06.868705 3563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:06.868770 3563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:06.881867 3563 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:32839
I20260811 07:33:06.881896 3752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:32839 every 8 connection(s)
I20260811 07:33:06.883312 3563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:33:06.892654 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 3563
I20260811 07:33:06.893332 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:45057
--local_ip_for_outbound_sockets=127.22.4.195
--tserver_master_addrs=127.22.4.254:38671
--webserver_port=37639
--webserver_interface=127.22.4.195
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.22.4.195
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:33:06.899838 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:06.886278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:40287 (local address 127.22.4.254:38671)
0811 07:33:06.886521 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:06.886527 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:06.887671 (+ 1144us) server_negotiation.cc:407] Connection header received
0811 07:33:06.889501 (+ 1830us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:06.889505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:06.889580 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:06.889705 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:06.891819 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.892474 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.894200 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.894439 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.894566 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.899595 (+ 5029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:40287: BlockingRecv error: recv got EOF from 127.22.4.194:40287 (error 108)
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 07:33:06.900892 3757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:06.886706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:40287)
0811 07:33:06.887430 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:06.887497 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:06.889161 (+ 1664us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:06.890010 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:06.890021 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:06.890594 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:06.891532 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.891552 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.892728 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.892732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.894007 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.894026 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.894634 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.894639 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.894919 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.895903 (+ 984us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:06.895925 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:06.899252 (+ 3327us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":159,"threads_started":1}
W20260811 07:33:06.901777 3754 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:38671 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.4.254:38671: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:06.909461 3757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:06.902476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:52635)
0811 07:33:06.902641 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:06.902661 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:06.902807 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:06.903185 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:06.903188 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:06.903433 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:06.903568 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.903575 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.904406 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.904410 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.905026 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.905035 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.905551 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.905555 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.905664 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.906432 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:06.906447 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:06.909300 (+ 2853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260811 07:33:06.909907 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:06.902706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:52635 (local address 127.22.4.254:38671)
0811 07:33:06.902931 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:06.902940 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:06.902954 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:33:06.903011 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:06.903013 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:06.903061 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:06.903160 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:06.903703 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.904282 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.905176 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.905414 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.905528 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.909678 (+ 4150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:52635: BlockingRecv error: recv got EOF from 127.22.4.194:52635 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:06 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:06.919137 3757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:06.910353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:57987)
0811 07:33:06.910682 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:06.910706 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:06.910920 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:06.911433 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:06.911436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:06.911668 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:06.911832 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.911840 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.912858 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.912863 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.913923 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:06.913947 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.914633 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.914637 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:06.914756 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.915682 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:06.915703 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:06.918899 (+ 3196us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167}
W20260811 07:33:06.919418 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:06.910526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:57987 (local address 127.22.4.254:38671)
0811 07:33:06.910697 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:06.910702 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:06.910903 (+ 201us) server_negotiation.cc:407] Connection header received
0811 07:33:06.911118 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:06.911121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:06.911247 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:06.911372 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:06.912033 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.912668 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.914178 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:06.914459 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:06.914584 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:06.919099 (+ 4515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:57987: BlockingRecv error: recv got EOF from 127.22.4.194:57987 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 07:33:06.919493 3754 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:33:07.055608 3758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:07.056002 3758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:07.056105 3758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:07.061143 3758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:07.061285 3758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:07.061407 3758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:33:07.067905 3758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/krb5kdc/oryx_127.22.4.195.keytab
--principal=oryx/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:45057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=37639
--tserver_master_addrs=127.22.4.254:38671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:07.069300 3758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:07.070518 3758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:07.083546 3774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:07.083750 3758 server_base.cc:1034] running on GCE node
W20260811 07:33:07.083570 3769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:07.083580 3770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:07.084659 3758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:07.085808 3758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:07.087586 3758 hybrid_clock.cc:648] HybridClock initialized: now 1786433587087543 us; error 87 us; skew 500 ppm
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433587, etypes {rep=17 tkt=17 ses=17}, oryx/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:07.093796 3758 init.cc:377] Logged in from keytab as oryx/127.22.4.195@KRBTEST.COM (short username oryx)
I20260811 07:33:07.095475 3758 webserver.cc:460] Webserver started at http://127.22.4.195:37639/ using document root <none> and password file <none>
I20260811 07:33:07.096273 3758 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:07.096417 3758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:07.104368 3758 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:33:07.107885 3783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:07.110249 3758 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:33:07.110699 3758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "10123ae66426441c99477e83a1c8a96b"
format_stamp: "Formatted at 2026-08-11 07:33:05 on dist-test-slave-7z32"
server_key: "19564b92d6e0fd7170e5fa00c1e5b782"
server_key_iv: "c75f1a33b8ad316739e68dc75e2a414c"
server_key_version: "encryptionkey@0"
I20260811 07:33:07.111737 3758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:07.137751 3758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:07.143812 3758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:07.144280 3758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:07.145061 3758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:07.146641 3758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:07.146741 3758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:07.146808 3758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:07.146833 3758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:07.158651 3758 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:45057
I20260811 07:33:07.158679 3973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:45057 every 8 connection(s)
I20260811 07:33:07.159878 3758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:33:07.168254 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 3758
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
W20260811 07:33:07.179358 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:07.163012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:41531 (local address 127.22.4.254:38671)
0811 07:33:07.163343 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:07.163351 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:07.164646 (+ 1295us) server_negotiation.cc:407] Connection header received
0811 07:33:07.166391 (+ 1745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:07.166395 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:07.166490 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:07.166895 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:07.168991 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.169934 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.172205 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.172749 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.172912 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.179042 (+ 6130us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:41531: BlockingRecv error: recv got EOF from 127.22.4.195:41531 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
I20260811 07:33:07.180270 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:07.163598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:41531)
0811 07:33:07.164382 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:07.164452 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:07.166010 (+ 1558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:07.167202 (+ 1192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:07.167214 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:07.167669 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:07.168486 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.168511 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.170253 (+ 1742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.170259 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.171844 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.171865 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.173045 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.173049 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.173318 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.174273 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:07.174322 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:07.178610 (+ 4288us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":201,"threads_started":1}
W20260811 07:33:07.181740 3975 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:38671 (0 consecutive failures): Not authorized: Failed to ping master at 127.22.4.254:38671: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
I20260811 07:33:07.185181 3979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:07.169850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53802 (local address 127.22.4.254:38671)
0811 07:33:07.170261 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:07.170265 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:07.170279 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:33:07.170327 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:07.170333 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:07.170408 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:07.170527 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:07.171564 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.172273 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.173759 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.174088 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.174235 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.177242 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:07.177253 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:07.177287 (+ 34us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:07.177348 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:07.180772 (+ 3424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:07.181869 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:07.181878 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:07.181886 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:07.182182 (+ 296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:07.182783 (+ 601us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:07.182791 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:07.182794 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:07.183545 (+ 751us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:07.183770 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:07.184263 (+ 493us) server_negotiation.cc:299] Negotiation successful
0811 07:33:07.184846 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":132,"threads_started":1}
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:07.190918 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:07.182481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:56985)
0811 07:33:07.182619 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:07.182636 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:07.182738 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:07.183090 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:07.183093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:07.183300 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:07.183459 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.183468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.184864 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.184869 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.185772 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.185790 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.186446 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.186451 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.186598 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.187456 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:07.187471 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:07.190696 (+ 3225us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 07:33:07.191478 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:07.182593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:56985 (local address 127.22.4.254:38671)
0811 07:33:07.182795 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:07.182799 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:07.182811 (+ 12us) server_negotiation.cc:407] Connection header received
0811 07:33:07.182906 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:07.182908 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:07.182954 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:07.183027 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:07.183604 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.184572 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.185949 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.186269 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.186425 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.190957 (+ 4532us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:56985: BlockingRecv error: recv got EOF from 127.22.4.195:56985 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:07.198653 3977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:07.191897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:43751)
0811 07:33:07.192142 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:07.192157 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:07.192270 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:07.192606 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:07.192609 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:07.192797 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:07.192919 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.192924 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.193853 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.193856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.194493 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.194504 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.195187 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.195190 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.195284 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.196098 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:07.196113 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:07.198479 (+ 2366us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162}
W20260811 07:33:07.199122 3975 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:33:07.199440 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:07.191767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:43751 (local address 127.22.4.254:38671)
0811 07:33:07.191967 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:07.191974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:07.192260 (+ 286us) server_negotiation.cc:407] Connection header received
0811 07:33:07.192370 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:07.192372 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:07.192427 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:07.192521 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:07.193055 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.193620 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.194643 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.195023 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.195126 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.198758 (+ 3632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:43751: BlockingRecv error: recv got EOF from 127.22.4.195:43751 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:07.639247 3980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:07.631217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:58415)
0811 07:33:07.632112 (+ 895us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:07.632133 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:07.632312 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:07.632650 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:07.632653 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:07.632922 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:07.633120 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.633130 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.633941 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.633944 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.634659 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.634671 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.635296 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.635300 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.635396 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.636234 (+ 838us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:07.636248 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:07.639048 (+ 2800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":120,"threads_started":1}
W20260811 07:33:07.639612 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:07.631372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:58415 (local address 127.22.4.254:38671)
0811 07:33:07.631590 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:07.631596 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:07.632253 (+ 657us) server_negotiation.cc:407] Connection header received
0811 07:33:07.632429 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:07.632432 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:07.632494 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:07.632597 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:07.633256 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.633801 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.634800 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.635130 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.635225 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.639344 (+ 4119us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:58415: BlockingRecv error: recv got EOF from 127.22.4.193:58415 (error 108)
Metrics: {"server-negotiator.queue_time_us":107}
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:07 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:07.927302 3982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:07.920222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:58969)
0811 07:33:07.920633 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:07.920655 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:07.920858 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:07.921172 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:07.921174 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:07.921454 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:07.921608 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.921618 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.922450 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.922455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.923245 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:07.923256 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.923769 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.923773 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:07.923858 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.924574 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:07.924587 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:07.927133 (+ 2546us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":119,"threads_started":1}
W20260811 07:33:07.927482 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:07.920362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:58969 (local address 127.22.4.254:38671)
0811 07:33:07.920589 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:07.920595 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:07.920766 (+ 171us) server_negotiation.cc:407] Connection header received
0811 07:33:07.920972 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:07.920977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:07.921039 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:07.921135 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:07.921740 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.922327 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.923378 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:07.923628 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:07.923758 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:07.927315 (+ 3557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:58969: BlockingRecv error: recv got EOF from 127.22.4.194:58969 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 11 07:33:08 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:08 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:08.207706 3983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:08.200264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:49111)
0811 07:33:08.200714 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:08.200736 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:08.200957 (+ 221us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:08.201350 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:08.201353 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:08.201641 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:08.201768 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:08.201774 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.202622 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.202627 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:08.203340 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:08.203350 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.203874 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.203877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:08.203970 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:08.204694 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:08.204707 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:08.207529 (+ 2822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":187,"threads_started":1}
W20260811 07:33:08.208099 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:08.200477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:49111 (local address 127.22.4.254:38671)
0811 07:33:08.200689 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:08.200694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:08.200864 (+ 170us) server_negotiation.cc:407] Connection header received
0811 07:33:08.201137 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:08.201141 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:08.201204 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:08.201313 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:08.201908 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.202492 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.203483 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.203730 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.203858 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:08.207877 (+ 4019us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:49111: BlockingRecv error: recv got EOF from 127.22.4.195:49111 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 07:33:08 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:08 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:08.648753 3984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:08.640528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:54919)
0811 07:33:08.641038 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:08.641059 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:08.641267 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:08.641672 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:08.641675 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:08.642032 (+ 357us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:08.642167 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:08.642174 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.643143 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.643147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:08.643928 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:08.643940 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.644524 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.644528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:08.644613 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:08.645361 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:08.645375 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:08.648568 (+ 3193us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":173,"threads_started":1}
W20260811 07:33:08.649046 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:08.640828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:54919 (local address 127.22.4.254:38671)
0811 07:33:08.641038 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:08.641045 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:08.641159 (+ 114us) server_negotiation.cc:407] Connection header received
0811 07:33:08.641441 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:08.641444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:08.641498 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:08.641636 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:08.642339 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.643011 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.644088 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.644364 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.644505 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:08.648863 (+ 4358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:54919: BlockingRecv error: recv got EOF from 127.22.4.193:54919 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 11 07:33:08 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:08 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:08.935731 3985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:08.928447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:39185)
0811 07:33:08.928899 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:08.928916 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:08.929056 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:08.929367 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:08.929370 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:08.929680 (+ 310us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:08.929824 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:08.929831 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.930755 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.930758 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:08.931529 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:08.931539 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.932180 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.932184 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:08.932263 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:08.932949 (+ 686us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:08.932963 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:08.935575 (+ 2612us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":346,"thread_start_us":143,"threads_started":1}
W20260811 07:33:08.935969 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:08.928628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:39185 (local address 127.22.4.254:38671)
0811 07:33:08.928799 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:08.928803 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:08.929048 (+ 245us) server_negotiation.cc:407] Connection header received
0811 07:33:08.929151 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:08.929153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:08.929217 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:08.929317 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:08.929964 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.930563 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.931702 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:08.931967 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:08.932108 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:08.935781 (+ 3673us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:39185: BlockingRecv error: recv got EOF from 127.22.4.194:39185 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 07:33:09 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:09 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:09.216850 3988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:09.208985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:44159)
0811 07:33:09.209457 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:09.209481 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:09.209666 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:09.210118 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:09.210122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:09.210542 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:09.210695 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:09.210702 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.211618 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.211623 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:09.212495 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:09.212508 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.213088 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.213092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:09.213186 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:09.213912 (+ 726us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:09.213927 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:09.216698 (+ 2771us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":145,"threads_started":1}
W20260811 07:33:09.217336 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:09.209222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:44159 (local address 127.22.4.254:38671)
0811 07:33:09.209414 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:09.209419 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:09.209582 (+ 163us) server_negotiation.cc:407] Connection header received
0811 07:33:09.209916 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:09.209922 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:09.209989 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:09.210090 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:09.210889 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.211478 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.212668 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.212935 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.213074 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:09.217146 (+ 4072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:44159: BlockingRecv error: recv got EOF from 127.22.4.195:44159 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 11 07:33:09 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:09 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:09.664276 3989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:09.649820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:39755)
0811 07:33:09.650184 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:09.650200 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:09.650353 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:09.650814 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:09.650816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:09.651151 (+ 335us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:09.651266 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:09.651273 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.652205 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.652209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:09.652955 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:09.652968 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.653599 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.653603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:09.653686 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:09.660811 (+ 7125us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:09.660835 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:09.664065 (+ 3230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":112,"threads_started":1}
W20260811 07:33:09.664398 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:09.649948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:39755 (local address 127.22.4.254:38671)
0811 07:33:09.650177 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:09.650183 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:09.650296 (+ 113us) server_negotiation.cc:407] Connection header received
0811 07:33:09.650531 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:09.650541 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:09.650599 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:09.650653 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:09.651428 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.652053 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.653138 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.653422 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.653538 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:09.664256 (+ 10718us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:39755: BlockingRecv error: recv got EOF from 127.22.4.193:39755 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 11 07:33:09 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:09 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:09.945308 3990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:09.936999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:43007)
0811 07:33:09.937532 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:09.937627 (+ 95us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:09.937866 (+ 239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:09.938231 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:09.938234 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:09.938535 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:09.938672 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:09.938678 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.939668 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.939673 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:09.940378 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:09.940388 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.940979 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.940983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:09.941104 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:09.941899 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:09.941915 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:09.945020 (+ 3105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":161,"threads_started":1}
W20260811 07:33:09.945457 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:09.937293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:43007 (local address 127.22.4.254:38671)
0811 07:33:09.937532 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:09.937541 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:09.937762 (+ 221us) server_negotiation.cc:407] Connection header received
0811 07:33:09.938006 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:09.938010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:09.938080 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:09.938191 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:09.938860 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.939526 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.940537 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:09.940814 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:09.940948 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:09.945297 (+ 4349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:43007: BlockingRecv error: recv got EOF from 127.22.4.194:43007 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
Aug 11 07:33:10 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:10 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:10.226433 3991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:10.218188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:38031)
0811 07:33:10.218622 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:10.218641 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:10.218908 (+ 267us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:10.219270 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:10.219272 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:10.219547 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:10.219688 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:10.219694 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.220659 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.220662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:10.221421 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:10.221435 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.222154 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.222157 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:10.222230 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:10.223027 (+ 797us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:10.223040 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:10.226145 (+ 3105us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":127,"threads_started":1}
W20260811 07:33:10.226572 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:10.218414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:38031 (local address 127.22.4.254:38671)
0811 07:33:10.218640 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:10.218664 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:10.218767 (+ 103us) server_negotiation.cc:407] Connection header received
0811 07:33:10.219040 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:10.219043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:10.219108 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:10.219226 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:10.219853 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.220494 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.221651 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.221969 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.222085 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:10.226408 (+ 4323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:38031: BlockingRecv error: recv got EOF from 127.22.4.195:38031 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Aug 11 07:33:10 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:10 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:10.674892 3994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:10.665872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:44545)
0811 07:33:10.666478 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:10.666502 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:10.666776 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:10.667193 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:10.667196 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:10.667488 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:10.667703 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:10.667711 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.668674 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.668680 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:10.669356 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:10.669365 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.669913 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.669917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:10.670009 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:10.671025 (+ 1016us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:10.671044 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:10.674667 (+ 3623us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":136,"threads_started":1}
W20260811 07:33:10.675400 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:10.666165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:44545 (local address 127.22.4.254:38671)
0811 07:33:10.666478 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:10.666487 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:10.666678 (+ 191us) server_negotiation.cc:407] Connection header received
0811 07:33:10.666966 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:10.666970 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:10.667048 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:10.667160 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:10.667853 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.668518 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.669491 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.669764 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.669896 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:10.675143 (+ 5247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:44545: BlockingRecv error: recv got EOF from 127.22.4.193:44545 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
Aug 11 07:33:10 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:10 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:10.954130 3996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:10.946500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:35783)
0811 07:33:10.947115 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:10.947134 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:10.947287 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:10.947670 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:10.947672 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:10.947896 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:10.948076 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:10.948082 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.949053 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.949056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:10.949748 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:10.949759 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.950424 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.950428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:10.950507 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:10.951250 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:10.951263 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:10.953972 (+ 2709us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":509,"thread_start_us":243,"threads_started":1}
W20260811 07:33:10.954499 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:10.946661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:35783 (local address 127.22.4.254:38671)
0811 07:33:10.946929 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:10.946935 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:10.947269 (+ 334us) server_negotiation.cc:407] Connection header received
0811 07:33:10.947445 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:10.947448 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:10.947513 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:10.947618 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:10.948250 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.948882 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.949911 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:10.950185 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:10.950297 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:10.954315 (+ 4018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:35783: BlockingRecv error: recv got EOF from 127.22.4.194:35783 (error 108)
Metrics: {"server-negotiator.queue_time_us":110}
Aug 11 07:33:11 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:11 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:11.240135 3997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:11.227559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:41501)
0811 07:33:11.227930 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:11.227947 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:11.228097 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:11.228576 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:11.228583 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:11.228799 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:11.228952 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:11.228959 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.230049 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.230052 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:11.230657 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:11.230666 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.231236 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.231239 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:11.231315 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:11.236799 (+ 5484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:11.236860 (+ 61us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:11.239924 (+ 3064us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":115,"threads_started":1}
W20260811 07:33:11.240407 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:11.227702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:41501 (local address 127.22.4.254:38671)
0811 07:33:11.227893 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:11.227898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:11.228038 (+ 140us) server_negotiation.cc:407] Connection header received
0811 07:33:11.228312 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:11.228316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:11.228394 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:11.228497 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:11.229108 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.229850 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.230796 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.231087 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.231189 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:11.240198 (+ 9009us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:41501: BlockingRecv error: recv got EOF from 127.22.4.195:41501 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 07:33:11 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:11 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:11.683933 4000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:11.676055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:55807)
0811 07:33:11.676369 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:11.676393 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:11.676578 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:11.676908 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:11.676911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:11.677140 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:11.677261 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:11.677268 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.678303 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.678307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:11.679057 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:11.679069 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.679565 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.679568 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:11.679634 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:11.680404 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:11.680417 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:11.683759 (+ 3342us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":120,"threads_started":1}
W20260811 07:33:11.684324 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:11.676162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:55807 (local address 127.22.4.254:38671)
0811 07:33:11.676330 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:11.676335 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:11.676517 (+ 182us) server_negotiation.cc:407] Connection header received
0811 07:33:11.676671 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:11.676673 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:11.676732 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:11.676823 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:11.677430 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.678149 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.679204 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.679440 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.679539 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:11.684089 (+ 4550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:55807: BlockingRecv error: recv got EOF from 127.22.4.193:55807 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 11 07:33:11 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:11 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:11.964864 4001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:11.955496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:57531)
0811 07:33:11.956034 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:11.956054 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:11.956268 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:11.956609 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:11.956612 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:11.956913 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:11.957048 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:11.957054 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.958305 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.958310 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:11.959340 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:11.959364 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.960262 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.960269 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:11.960406 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:11.961234 (+ 828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:11.961250 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:11.964622 (+ 3372us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":99,"threads_started":1}
W20260811 07:33:11.965029 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:11.956059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:57531 (local address 127.22.4.254:38671)
0811 07:33:11.956274 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:11.956280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:11.956302 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:33:11.956408 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:11.956412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:11.956465 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:11.956573 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:11.957208 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.957807 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.959652 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:11.959915 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:11.960285 (+ 370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:11.964864 (+ 4579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:57531: BlockingRecv error: recv got EOF from 127.22.4.194:57531 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 11 07:33:12 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:12 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:12.249084 4003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:12.241236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:56769)
0811 07:33:12.241784 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:12.241812 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:12.242075 (+ 263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:12.242449 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:12.242452 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:12.242767 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:12.242931 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:12.242938 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.243855 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.243861 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:12.244568 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:12.244578 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.245131 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.245136 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:12.245274 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:12.245995 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:12.246010 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:12.248878 (+ 2868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":121,"threads_started":1}
W20260811 07:33:12.249389 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:12.241564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:56769 (local address 127.22.4.254:38671)
0811 07:33:12.241783 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:12.241791 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:12.242030 (+ 239us) server_negotiation.cc:407] Connection header received
0811 07:33:12.242242 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:12.242244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:12.242302 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:12.242413 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:12.243083 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.243719 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.244725 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.244981 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.245112 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:12.249122 (+ 4010us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:56769: BlockingRecv error: recv got EOF from 127.22.4.195:56769 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 07:33:12 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:12 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:12.693068 4004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:12.685238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:54187)
0811 07:33:12.685667 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:12.685684 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:12.685827 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:12.686173 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:12.686175 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:12.686421 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:12.686547 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:12.686552 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.687707 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.687710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:12.688434 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:12.688446 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.689007 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.689010 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:12.689109 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:12.689967 (+ 858us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:12.689991 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:12.692874 (+ 2883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":146,"threads_started":1}
W20260811 07:33:12.693145 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:12.685342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:54187 (local address 127.22.4.254:38671)
0811 07:33:12.685504 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:12.685508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:12.685810 (+ 302us) server_negotiation.cc:407] Connection header received
0811 07:33:12.685940 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:12.685944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:12.686015 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:12.686127 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:12.686788 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.687542 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.688599 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.688826 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.688949 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:12.693019 (+ 4070us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:54187: BlockingRecv error: recv got EOF from 127.22.4.193:54187 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 07:33:12 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:12 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:12.972965 4005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:12.966270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:34181)
0811 07:33:12.966634 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:12.966651 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:12.966781 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:12.967166 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:12.967168 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:12.967420 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:12.967540 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:12.967546 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.968462 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.968465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:12.969058 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:12.969067 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.969582 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.969585 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:12.969655 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:12.970335 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:12.970348 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:12.972819 (+ 2471us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":133,"threads_started":1}
W20260811 07:33:12.973305 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:12.966339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:34181 (local address 127.22.4.254:38671)
0811 07:33:12.966546 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:12.966553 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:12.966776 (+ 223us) server_negotiation.cc:407] Connection header received
0811 07:33:12.966951 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:12.966954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:12.967015 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:12.967102 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:12.967686 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.968313 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.969205 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:12.969455 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:12.969550 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:12.973119 (+ 3569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:34181: BlockingRecv error: recv got EOF from 127.22.4.194:34181 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 11 07:33:13 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:13 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:13.256918 4006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:13.250218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:38025)
0811 07:33:13.250722 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:13.250740 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:13.250975 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:13.251335 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:13.251338 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:13.251617 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:13.251734 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:13.251740 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.252549 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.252554 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:13.253143 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:13.253151 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.253618 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.253622 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:13.253712 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:13.254392 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:13.254404 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:13.256704 (+ 2300us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":107,"threads_started":1}
W20260811 07:33:13.256969 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:13.250432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:38025 (local address 127.22.4.254:38671)
0811 07:33:13.250647 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:13.250653 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:13.250880 (+ 227us) server_negotiation.cc:407] Connection header received
0811 07:33:13.251139 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:13.251142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:13.251204 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:13.251302 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:13.251859 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.252437 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.253262 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.253489 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.253599 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:13.256853 (+ 3254us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:38025: BlockingRecv error: recv got EOF from 127.22.4.195:38025 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 11 07:33:13 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:13 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:13.701997 4008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:13.694389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:41981)
0811 07:33:13.694956 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:13.694973 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:13.695139 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:13.695514 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:13.695517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:13.695760 (+ 243us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:13.695869 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:13.695876 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.696663 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.696667 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:13.697265 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:13.697273 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.697745 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.697748 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:13.697840 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:13.698560 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:13.698573 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:13.701731 (+ 3158us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":159,"threads_started":1}
W20260811 07:33:13.702091 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:13.694496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:41981 (local address 127.22.4.254:38671)
0811 07:33:13.694711 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:13.694718 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:13.695068 (+ 350us) server_negotiation.cc:407] Connection header received
0811 07:33:13.695271 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:13.695273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:13.695385 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:13.695484 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:13.695993 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.696547 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.697390 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.697613 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.697730 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:13.701948 (+ 4218us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:41981: BlockingRecv error: recv got EOF from 127.22.4.193:41981 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 11 07:33:13 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:13 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:13.981467 4009 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:13.974428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:58487)
0811 07:33:13.974899 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:13.974915 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:13.975237 (+ 322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:13.975683 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:13.975686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:13.975962 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:13.976082 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:13.976089 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.976953 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.976958 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:13.977540 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:13.977549 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.978050 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.978054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:13.978133 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:13.978933 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:13.978949 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:13.981243 (+ 2294us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":129,"threads_started":1}
W20260811 07:33:13.981529 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:13.974633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:58487 (local address 127.22.4.254:38671)
0811 07:33:13.975073 (+ 440us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:13.975077 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:13.975104 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:33:13.975456 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:13.975461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:13.975536 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:13.975646 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:13.976226 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.976822 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.977681 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:13.977923 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:13.978038 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:13.981403 (+ 3365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:58487: BlockingRecv error: recv got EOF from 127.22.4.194:58487 (error 108)
Metrics: {"server-negotiator.queue_time_us":321}
Aug 11 07:33:14 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:14 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:14.265232 4011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:14.258394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:47153)
0811 07:33:14.258906 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:14.258927 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:14.259070 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:14.259410 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:14.259413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:14.259678 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:14.259820 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:14.259827 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.260646 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.260649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:14.261419 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:14.261430 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.261993 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.261996 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:14.262081 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:14.262792 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:14.262804 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:14.265106 (+ 2302us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":219,"threads_started":1}
W20260811 07:33:14.265643 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:14.258456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:47153 (local address 127.22.4.254:38671)
0811 07:33:14.258662 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:14.258667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:14.259024 (+ 357us) server_negotiation.cc:407] Connection header received
0811 07:33:14.259209 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:14.259212 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:14.259273 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:14.259355 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:14.259948 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.260534 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.261567 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.261817 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.261940 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:14.265434 (+ 3494us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:47153: BlockingRecv error: recv got EOF from 127.22.4.195:47153 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 11 07:33:14 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:14 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:14.721187 4012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:14.703490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:60153)
0811 07:33:14.704176 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:14.704214 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:14.704492 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:14.705067 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:14.705070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:14.705455 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:14.705646 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:14.705654 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.707568 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.707572 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:14.708530 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:14.708553 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.709487 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.709501 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:14.709634 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:14.716639 (+ 7005us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:14.716681 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:14.720856 (+ 4175us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":237,"threads_started":1}
W20260811 07:33:14.721730 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:14.703708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:60153 (local address 127.22.4.254:38671)
0811 07:33:14.703968 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:14.703973 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:14.704428 (+ 455us) server_negotiation.cc:407] Connection header received
0811 07:33:14.704663 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:14.704666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:14.704806 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:14.704953 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:14.705915 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.707309 (+ 1394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.708811 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.709154 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.709357 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:14.721339 (+ 11982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:60153: BlockingRecv error: recv got EOF from 127.22.4.193:60153 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 11 07:33:14 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:14 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:14.991230 4013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:14.982811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:46081)
0811 07:33:14.983276 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:14.983295 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:14.983460 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:14.983973 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:14.983976 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:14.984218 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:14.984360 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:14.984366 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.985570 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.985573 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:14.986207 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:14.986220 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.987063 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.987066 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:14.987153 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:14.988039 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:14.988053 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:14.991010 (+ 2957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":137,"threads_started":1}
W20260811 07:33:14.991360 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:14.983000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:46081 (local address 127.22.4.254:38671)
0811 07:33:14.983247 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:14.983256 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:14.983409 (+ 153us) server_negotiation.cc:407] Connection header received
0811 07:33:14.983598 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:14.983601 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:14.983666 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:14.983827 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:14.984539 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.985365 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.986387 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:14.986712 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:14.986906 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:14.991205 (+ 4299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:46081: BlockingRecv error: recv got EOF from 127.22.4.194:46081 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Aug 11 07:33:15 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:15 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:15.274044 4014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:15.266576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:46321)
0811 07:33:15.267012 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:15.267029 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:15.267243 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:15.267747 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:15.267751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:15.268010 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:15.268186 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:15.268195 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.269279 (+ 1084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.269282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:15.269986 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:15.269997 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.270617 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.270620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:15.270713 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:15.271536 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:15.271551 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:15.273872 (+ 2321us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":114,"threads_started":1}
W20260811 07:33:15.274456 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:15.266796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:46321 (local address 127.22.4.254:38671)
0811 07:33:15.267024 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:15.267030 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:15.267175 (+ 145us) server_negotiation.cc:407] Connection header received
0811 07:33:15.267447 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:15.267455 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:15.267543 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:15.267667 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:15.268403 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.269150 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.270169 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.270415 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.270520 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:15.274179 (+ 3659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:46321: BlockingRecv error: recv got EOF from 127.22.4.195:46321 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
Aug 11 07:33:15 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:15 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:15.729971 4016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:15.722498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:60027)
0811 07:33:15.722857 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:15.722878 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:15.723005 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:15.723526 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:15.723529 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:15.723748 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:15.723936 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:15.723948 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.724978 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.724984 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:15.725715 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:15.725727 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.726363 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.726366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:15.726494 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:15.727249 (+ 755us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:15.727262 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:15.729821 (+ 2559us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":139,"threads_started":1}
W20260811 07:33:15.730291 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:15.722877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:60027 (local address 127.22.4.254:38671)
0811 07:33:15.723062 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:15.723074 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:15.723107 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:33:15.723212 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:15.723215 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:15.723276 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:15.723396 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:15.724168 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.724848 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.725887 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.726208 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.726327 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:15.730099 (+ 3772us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:60027: BlockingRecv error: recv got EOF from 127.22.4.193:60027 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 07:33:15 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:15 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:16.001299 4020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:15.992607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:38283)
0811 07:33:15.993142 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:15.993160 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:15.993324 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:15.993736 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:15.993740 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:15.994005 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:15.994142 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:15.994148 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.995157 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.995161 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:15.995840 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:15.995851 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.996463 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.996468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:15.996579 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:15.997598 (+ 1019us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:15.997613 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:16.001087 (+ 3474us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":157,"threads_started":1}
W20260811 07:33:16.001426 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:15.992729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:38283 (local address 127.22.4.254:38671)
0811 07:33:15.992946 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:15.992952 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:15.993294 (+ 342us) server_negotiation.cc:407] Connection header received
0811 07:33:15.993418 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:15.993421 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:15.993482 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:15.993636 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:15.994346 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.994992 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.995978 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:15.996235 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:15.996346 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:16.001280 (+ 4934us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:38283: BlockingRecv error: recv got EOF from 127.22.4.194:38283 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 07:33:16 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:16 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:16.283972 4022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:16.275428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:41925)
0811 07:33:16.276004 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:16.276022 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:16.276194 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:16.276644 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:16.276647 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:16.276927 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:16.277087 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:16.277095 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:16.278196 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:16.278200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:16.278948 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:16.278961 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:16.279678 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:16.279682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:16.279772 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:16.280552 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:16.280567 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:16.283788 (+ 3221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":219,"threads_started":1}
W20260811 07:33:16.284510 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:16.275584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:41925 (local address 127.22.4.254:38671)
0811 07:33:16.275752 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:16.275756 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:16.276171 (+ 415us) server_negotiation.cc:407] Connection header received
0811 07:33:16.276365 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:16.276368 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:16.276430 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:16.276616 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:16.277267 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:16.277932 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:16.279166 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:16.279448 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:16.279616 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:16.284161 (+ 4545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:41925: BlockingRecv error: recv got EOF from 127.22.4.195:41925 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 07:33:16 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:16 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:16.739049 4023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:16.731473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:53031)
0811 07:33:16.731980 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:16.732001 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:16.732188 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:16.732499 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:16.732502 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:16.732777 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:16.732895 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:16.732902 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:16.733764 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:16.733770 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:16.734404 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:16.734415 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:16.734948 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:16.734951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:16.735039 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:16.735772 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:16.735786 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:16.738802 (+ 3016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":177,"threads_started":1}
W20260811 07:33:16.739302 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:16.731664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:53031 (local address 127.22.4.254:38671)
0811 07:33:16.731980 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:16.731988 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:16.732114 (+ 126us) server_negotiation.cc:407] Connection header received
0811 07:33:16.732325 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:16.732327 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:16.732375 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:16.732466 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:16.733034 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:16.733618 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:16.734542 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:16.734766 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:16.734923 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:16.739148 (+ 4225us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:53031: BlockingRecv error: recv got EOF from 127.22.4.193:53031 (error 108)
Metrics: {"server-negotiator.queue_time_us":184}
Aug 11 07:33:17 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:17 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:17.011199 4024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:17.003150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:41875)
0811 07:33:17.003542 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:17.003558 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:17.003738 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:17.004071 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:17.004073 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:17.004311 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:17.004429 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:17.004434 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.005416 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.005423 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:17.006039 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:17.006047 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.006547 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.006551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:17.006639 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:17.007693 (+ 1054us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:17.007707 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:17.011009 (+ 3302us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":105,"threads_started":1}
W20260811 07:33:17.011346 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:17.003290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:41875 (local address 127.22.4.254:38671)
0811 07:33:17.003501 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:17.003507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:17.003686 (+ 179us) server_negotiation.cc:407] Connection header received
0811 07:33:17.003863 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:17.003867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:17.003932 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:17.004031 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:17.004563 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.005244 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.006172 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.006410 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.006521 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:17.011224 (+ 4703us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:41875: BlockingRecv error: recv got EOF from 127.22.4.194:41875 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 11 07:33:17 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:17 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:17.293319 4025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:17.285423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:46375)
0811 07:33:17.285768 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:17.285789 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:17.285935 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:17.286308 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:17.286310 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:17.286558 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:17.286694 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:17.286701 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.287638 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.287648 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:17.288636 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:17.288654 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.289330 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.289336 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:17.289439 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:17.290398 (+ 959us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:17.290413 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:17.293093 (+ 2680us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":99,"threads_started":1}
W20260811 07:33:17.293357 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:17.285805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:46375 (local address 127.22.4.254:38671)
0811 07:33:17.286072 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:17.286076 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:17.286090 (+ 14us) server_negotiation.cc:407] Connection header received
0811 07:33:17.286137 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:17.286139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:17.286181 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:17.286276 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:17.286882 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.287407 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.288790 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.289089 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.289236 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:17.293245 (+ 4009us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:46375: BlockingRecv error: recv got EOF from 127.22.4.195:46375 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
Aug 11 07:33:17 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:17 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:17.748212 4027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:17.740470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:38715)
0811 07:33:17.741097 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:17.741113 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:17.741294 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:17.741693 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:17.741697 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:17.741977 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:17.742118 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:17.742125 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.743191 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.743195 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:17.743882 (+ 687us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:17.743893 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.744482 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.744487 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:17.744597 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:17.745350 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:17.745364 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:17.748058 (+ 2694us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":196,"threads_started":1}
W20260811 07:33:17.748690 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:17.740655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:38715 (local address 127.22.4.254:38671)
0811 07:33:17.740887 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:17.740898 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:17.741215 (+ 317us) server_negotiation.cc:407] Connection header received
0811 07:33:17.741426 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:17.741430 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:17.741498 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:17.741611 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:17.742261 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.743053 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.744044 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:17.744336 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:17.744465 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:17.748488 (+ 4023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:38715: BlockingRecv error: recv got EOF from 127.22.4.193:38715 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Aug 11 07:33:18 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:18 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:18.019884 4028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:18.012600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:43715)
0811 07:33:18.012966 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:18.012983 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:18.013166 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:18.013542 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:18.013545 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:18.013816 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:18.013981 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:18.013991 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.014877 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.014882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:18.015463 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:18.015471 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.015986 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.015990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:18.016069 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:18.016732 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:18.016744 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:18.019704 (+ 2960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":110,"threads_started":1}
W20260811 07:33:18.020208 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:18.012810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:43715 (local address 127.22.4.254:38671)
0811 07:33:18.012964 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:18.012968 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:18.013129 (+ 161us) server_negotiation.cc:407] Connection header received
0811 07:33:18.013312 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:18.013314 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:18.013378 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:18.013461 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:18.014141 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.014721 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.015623 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.015860 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.015972 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:18.019937 (+ 3965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:43715: BlockingRecv error: recv got EOF from 127.22.4.194:43715 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 11 07:33:18 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:18 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:18.302374 4030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:18.294676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:60431)
0811 07:33:18.295115 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:18.295133 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:18.295274 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:18.295664 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:18.295668 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:18.295985 (+ 317us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:18.296113 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:18.296120 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.297077 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.297080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:18.297732 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:18.297742 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.298394 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.298397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:18.298524 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:18.299181 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:18.299195 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:18.302111 (+ 2916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":157,"threads_started":1}
W20260811 07:33:18.302445 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:18.294657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:60431 (local address 127.22.4.254:38671)
0811 07:33:18.294884 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:18.294891 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:18.295265 (+ 374us) server_negotiation.cc:407] Connection header received
0811 07:33:18.295392 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:18.295403 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:18.295465 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:18.295562 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:18.296274 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.296886 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.297949 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.298218 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.298341 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:18.302306 (+ 3965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:60431: BlockingRecv error: recv got EOF from 127.22.4.195:60431 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 11 07:33:18 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:18 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:18.757009 4031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:18.749438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:39239)
0811 07:33:18.749892 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:18.749910 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:18.750048 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:18.750388 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:18.750391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:18.750608 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:18.750732 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:18.750738 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.751737 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.751740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:18.752381 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:18.752391 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.753059 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.753062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:18.753144 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:18.754040 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:18.754055 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:18.756849 (+ 2794us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":152,"threads_started":1}
W20260811 07:33:18.757427 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:18.749544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:39239 (local address 127.22.4.254:38671)
0811 07:33:18.749751 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:18.749758 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:18.750040 (+ 282us) server_negotiation.cc:407] Connection header received
0811 07:33:18.750161 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:18.750163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:18.750227 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:18.750316 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:18.750989 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.751575 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.752564 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:18.752813 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:18.752930 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:18.757208 (+ 4278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:39239: BlockingRecv error: recv got EOF from 127.22.4.193:39239 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 07:33:19 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:19 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:19.029374 4032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:19.021297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:46847)
0811 07:33:19.021904 (+ 607us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:19.021922 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:19.022126 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:19.022703 (+ 577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:19.022708 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:19.023087 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:19.023380 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:19.023389 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.024489 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.024493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:19.025349 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:19.025365 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.026002 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.026005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:19.026091 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:19.026868 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:19.026891 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:19.029211 (+ 2320us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":220,"threads_started":1}
W20260811 07:33:19.029769 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:19.021483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:46847 (local address 127.22.4.254:38671)
0811 07:33:19.021721 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:19.021730 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:19.022068 (+ 338us) server_negotiation.cc:407] Connection header received
0811 07:33:19.022291 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:19.022294 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:19.022374 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:19.022506 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:19.023507 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.024280 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.025531 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.025817 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.025959 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:19.029590 (+ 3631us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:46847: BlockingRecv error: recv got EOF from 127.22.4.194:46847 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Aug 11 07:33:19 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:19 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:19.311507 4033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:19.303597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:58061)
0811 07:33:19.304110 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:19.304131 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:19.304289 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:19.304739 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:19.304741 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:19.304962 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:19.305106 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:19.305112 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.306118 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.306122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:19.306792 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:19.306804 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.307557 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.307560 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:19.307643 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:19.308334 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:19.308347 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:19.311302 (+ 2955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":167,"threads_started":1}
W20260811 07:33:19.311857 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:19.303652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:58061 (local address 127.22.4.254:38671)
0811 07:33:19.303827 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:19.303831 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:19.304251 (+ 420us) server_negotiation.cc:407] Connection header received
0811 07:33:19.304471 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:19.304475 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:19.304545 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:19.304663 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:19.305310 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.305923 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.307027 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.307330 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.307468 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:19.311615 (+ 4147us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:58061: BlockingRecv error: recv got EOF from 127.22.4.195:58061 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 11 07:33:19 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:19 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:19.771113 4034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:19.758103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:53221)
0811 07:33:19.758422 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:19.758443 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:19.758563 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:19.759058 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:19.759060 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:19.759276 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:19.759376 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:19.759381 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.760382 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.760385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:19.761053 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:19.761063 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.761727 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.761730 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:19.761804 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:19.767194 (+ 5390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:19.767215 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:19.770871 (+ 3656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":115,"threads_started":1}
W20260811 07:33:19.771179 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:19.758270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:53221 (local address 127.22.4.254:38671)
0811 07:33:19.758452 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:19.758460 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:19.758524 (+ 64us) server_negotiation.cc:407] Connection header received
0811 07:33:19.758768 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:19.758772 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:19.758868 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:19.758960 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:19.759595 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.760225 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.761259 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:19.761517 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:19.761697 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:19.771043 (+ 9346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:53221: BlockingRecv error: recv got EOF from 127.22.4.193:53221 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 07:33:20 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:20 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:20.038203 4035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:20.030597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:60901)
0811 07:33:20.031162 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:20.031194 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:20.031375 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:20.031748 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:20.031752 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:20.032008 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:20.032120 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:20.032126 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.033011 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.033016 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:20.033654 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:20.033663 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.034214 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.034219 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:20.034325 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:20.035027 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:20.035041 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:20.037977 (+ 2936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":230,"threads_started":1}
W20260811 07:33:20.038516 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:20.030886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:60901 (local address 127.22.4.254:38671)
0811 07:33:20.031102 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:20.031109 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:20.031301 (+ 192us) server_negotiation.cc:407] Connection header received
0811 07:33:20.031549 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:20.031552 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:20.031603 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:20.031711 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:20.032262 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.032874 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.033796 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.034071 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.034199 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:20.038250 (+ 4051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:60901: BlockingRecv error: recv got EOF from 127.22.4.194:60901 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Aug 11 07:33:20 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:20 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:20.321064 4040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:20.312851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:44855)
0811 07:33:20.313303 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:20.313322 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:20.313490 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:20.314006 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:20.314010 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:20.314334 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:20.314478 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:20.314486 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.315758 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.315762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:20.316445 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:20.316457 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.317270 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.317273 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:20.317361 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:20.318101 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:20.318115 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:20.320852 (+ 2737us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":187,"threads_started":1}
W20260811 07:33:20.321117 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:20.313110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:44855 (local address 127.22.4.254:38671)
0811 07:33:20.313359 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:20.313365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:20.313509 (+ 144us) server_negotiation.cc:407] Connection header received
0811 07:33:20.313582 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:20.313585 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:20.313643 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:20.313914 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:20.314675 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.315532 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.316711 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.317004 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.317128 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:20.321001 (+ 3873us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:44855: BlockingRecv error: recv got EOF from 127.22.4.195:44855 (error 108)
Metrics: {"server-negotiator.queue_time_us":114}
Aug 11 07:33:20 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:20 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:20.780522 4041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:20.772407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:53921)
0811 07:33:20.772979 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:20.773002 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:20.773236 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:20.773630 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:20.773634 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:20.773888 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:20.773995 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:20.774001 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.774898 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.774902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:20.775554 (+ 652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:20.775565 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.776118 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.776122 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:20.776225 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:20.776893 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:20.776907 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:20.780277 (+ 3370us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":202,"threads_started":1}
W20260811 07:33:20.780951 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:20.772626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:53921 (local address 127.22.4.254:38671)
0811 07:33:20.773027 (+ 401us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:20.773036 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:20.773150 (+ 114us) server_negotiation.cc:407] Connection header received
0811 07:33:20.773385 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:20.773394 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:20.773445 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:20.773555 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:20.774139 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.774724 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.775698 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:20.775953 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:20.776086 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:20.780718 (+ 4632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:53921: BlockingRecv error: recv got EOF from 127.22.4.193:53921 (error 108)
Metrics: {"server-negotiator.queue_time_us":219}
Aug 11 07:33:21 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:21 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:21.046952 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:21.039437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:35543)
0811 07:33:21.039774 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:21.039800 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:21.039932 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:21.040288 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:21.040292 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:21.040541 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:21.040653 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:21.040659 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.041647 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.041653 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:21.042382 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:21.042393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.043026 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.043030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:21.043126 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:21.043844 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:21.043857 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:21.046682 (+ 2825us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":115,"threads_started":1}
W20260811 07:33:21.047473 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:21.039606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:35543 (local address 127.22.4.254:38671)
0811 07:33:21.039793 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:21.039798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:21.039912 (+ 114us) server_negotiation.cc:407] Connection header received
0811 07:33:21.040081 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:21.040088 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:21.040151 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:21.040253 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:21.040843 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.041524 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.042525 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.042814 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.043016 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:21.047293 (+ 4277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:35543: BlockingRecv error: recv got EOF from 127.22.4.194:35543 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Aug 11 07:33:21 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:21 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.195@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:21.329911 4044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:21.322665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.195:41795)
0811 07:33:21.323132 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:21.323153 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:21.323351 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:21.323743 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:21.323746 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:21.324013 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:21.324120 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:21.324126 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.325034 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.325040 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:21.325658 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:21.325668 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.326374 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.326378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:21.326460 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:21.327173 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:21.327186 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:21.329741 (+ 2555us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":154,"threads_started":1}
W20260811 07:33:21.330348 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:21.322863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:41795 (local address 127.22.4.254:38671)
0811 07:33:21.323127 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:21.323133 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:21.323270 (+ 137us) server_negotiation.cc:407] Connection header received
0811 07:33:21.323542 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:21.323547 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:21.323613 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:21.323714 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:21.324258 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.324894 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.325885 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.326178 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.326297 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:21.330148 (+ 3851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.195:41795: BlockingRecv error: recv got EOF from 127.22.4.195:41795 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 11 07:33:21 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:21 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.193@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:21.791909 4048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:21.781866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.193:57959)
0811 07:33:21.782697 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:21.782723 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:21.783186 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:21.783903 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:21.783907 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:21.784234 (+ 327us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:21.784420 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:21.784428 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.786107 (+ 1679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.786112 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:21.786998 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:21.787019 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.788160 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.788165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:21.788275 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:21.789167 (+ 892us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:21.789182 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:21.791729 (+ 2547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":696,"thread_start_us":116,"threads_started":1}
W20260811 07:33:21.792335 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:21.782061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:57959 (local address 127.22.4.254:38671)
0811 07:33:21.782272 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:21.782281 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:21.782875 (+ 594us) server_negotiation.cc:407] Connection header received
0811 07:33:21.783405 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:21.783416 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:21.783519 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:21.783683 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:21.784618 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.785758 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.787227 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:21.787829 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:21.788046 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:21.792095 (+ 4049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.193:57959: BlockingRecv error: recv got EOF from 127.22.4.193:57959 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 11 07:33:22 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
Aug 11 07:33:22 dist-test-slave-7z32 krb5kdc[2496](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.22.4.194@KRBTEST.COM for oryx/127.22.4.254@KRBTEST.COM, Server not found in Kerberos database
I20260811 07:33:22.058570 4049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:22.048499 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38671 (local address 127.22.4.194:52369)
0811 07:33:22.048982 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:22.049003 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:22.049278 (+ 275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:22.049710 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:22.049714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:22.050037 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:22.050200 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:22.050209 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.051679 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.051683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:22.052646 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:22.052661 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.053658 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.053662 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:22.053762 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:22.055417 (+ 1655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:22.055434 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:22.058420 (+ 2986us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.22.4.254:38671: Server oryx/127.22.4.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":145,"threads_started":1}
W20260811 07:33:22.059305 3559 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:22.048705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:52369 (local address 127.22.4.254:38671)
0811 07:33:22.048955 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:22.048962 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:22.049192 (+ 230us) server_negotiation.cc:407] Connection header received
0811 07:33:22.049423 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:22.049426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:22.049479 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:22.049681 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:22.050522 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.051261 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.052864 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.053333 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.053535 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:22.059044 (+ 5509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.22.4.194:52369: BlockingRecv error: recv got EOF from 127.22.4.194:52369 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:33:22.170707 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 3324
I20260811 07:33:22.193174 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 3563
I20260811 07:33:22.207816 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 3758
I20260811 07:33:22.241916 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 3222
2026-08-11T07:33:22Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (19480 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T07:33:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:33:22Z Disabled control of system clock
I20260811 07:33:22.295739 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:36937
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:44751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:36937
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 07:33:22.446965 4053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:22.447371 4053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:22.447712 4053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:22.452544 4053 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:33:22.452652 4053 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:22.452669 4053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:22.452687 4053 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:33:22.452704 4053 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:33:22.458060 4053 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:36937
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:36937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4053
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:22.459404 4053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:22.461680 4053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:22.475397 4065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:22.475531 4053 server_base.cc:1034] running on GCE node
W20260811 07:33:22.475405 4064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:22.475405 4067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:22.477516 4053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:22.479094 4053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:22.482594 4053 hybrid_clock.cc:648] HybridClock initialized: now 1786433602482515 us; error 89 us; skew 500 ppm
I20260811 07:33:22.485939 4053 webserver.cc:460] Webserver started at http://127.22.4.254:39725/ using document root <none> and password file <none>
I20260811 07:33:22.486816 4053 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:22.486995 4053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:22.487304 4053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:22.489972 4053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "8c65f0c512d94779953ead2c63597097"
format_stamp: "Formatted at 2026-08-11 07:33:22 on dist-test-slave-7z32"
server_key: "d23c757419beef42899c9f2b4894aed5"
server_key_iv: "267c622b6c5f0ee041df39f8b68a781d"
server_key_version: "encryptionkey@0"
I20260811 07:33:22.490705 4053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "8c65f0c512d94779953ead2c63597097"
format_stamp: "Formatted at 2026-08-11 07:33:22 on dist-test-slave-7z32"
server_key: "d23c757419beef42899c9f2b4894aed5"
server_key_iv: "267c622b6c5f0ee041df39f8b68a781d"
server_key_version: "encryptionkey@0"
I20260811 07:33:22.495945 4053 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:33:22.500149 4077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:22.502228 4053 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260811 07:33:22.502532 4053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "8c65f0c512d94779953ead2c63597097"
format_stamp: "Formatted at 2026-08-11 07:33:22 on dist-test-slave-7z32"
server_key: "d23c757419beef42899c9f2b4894aed5"
server_key_iv: "267c622b6c5f0ee041df39f8b68a781d"
server_key_version: "encryptionkey@0"
I20260811 07:33:22.502723 4053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:22.524497 4053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:22.525506 4053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:22.525767 4053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:22.535358 4053 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:36937
I20260811 07:33:22.535383 4156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:36937 every 8 connection(s)
I20260811 07:33:22.536656 4053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:33:22.540071 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 4053
I20260811 07:33:22.540248 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:33:22.540670 22547 external_mini_cluster.cc:1428] Setting key f8165f5e3394c568a3b6b50162be84ff
I20260811 07:33:22.542701 4158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:22.551504 4158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097: Bootstrap starting.
I20260811 07:33:22.554716 4158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:22.554790 4161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:22.542659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.22.4.254:36937)
0811 07:33:22.544171 (+ 1512us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:22.544211 (+ 40us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:22.544340 (+ 129us) server_negotiation.cc:407] Connection header received
0811 07:33:22.545373 (+ 1033us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:22.545400 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:22.545993 (+ 593us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:22.546470 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:22.547145 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.548665 (+ 1520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.550054 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.550796 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.551045 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:22.552375 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:22.552382 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:22.552400 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:33:22.552966 (+ 566us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:22.553055 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:33:22.553090 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:22.553217 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:22.553429 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 07:33:22.553745 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":343,"threads_started":1}
I20260811 07:33:22.555842 4158 log.cc:824] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097: Log is configured to *not* fsync() on all Append() calls
I20260811 07:33:22.558429 4158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097: No bootstrap required, opened a new log
I20260811 07:33:22.562355 4158 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c65f0c512d94779953ead2c63597097" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36937 } }
I20260811 07:33:22.562657 4158 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:22.562708 4158 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c65f0c512d94779953ead2c63597097, State: Initialized, Role: FOLLOWER
I20260811 07:33:22.563304 4158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c65f0c512d94779953ead2c63597097" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36937 } }
I20260811 07:33:22.563545 4158 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:33:22.563617 4158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:33:22.563726 4158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:22.564929 4158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c65f0c512d94779953ead2c63597097" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36937 } }
I20260811 07:33:22.565313 4158 leader_election.cc:302] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c65f0c512d94779953ead2c63597097; no voters:
I20260811 07:33:22.565672 4158 leader_election.cc:288] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:33:22.566169 4164 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:33:22.566581 4164 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [term 1 LEADER]: Becoming Leader. State: Replica: 8c65f0c512d94779953ead2c63597097, State: Running, Role: LEADER
I20260811 07:33:22.567185 4164 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c65f0c512d94779953ead2c63597097" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36937 } }
I20260811 07:33:22.567643 4158 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:33:22.569890 4165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c65f0c512d94779953ead2c63597097" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c65f0c512d94779953ead2c63597097" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36937 } } }
I20260811 07:33:22.569871 4166 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c65f0c512d94779953ead2c63597097. Latest consensus state: current_term: 1 leader_uuid: "8c65f0c512d94779953ead2c63597097" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c65f0c512d94779953ead2c63597097" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36937 } } }
I20260811 07:33:22.570137 4165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:22.570137 4166 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097 [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:22.571091 4179 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:33:22.576432 4179 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:33:22.584187 4179 catalog_manager.cc:1347] Generated new cluster ID: c055c492ed394bad86ede0990ef976fc
I20260811 07:33:22.584327 4179 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:33:22.602032 4179 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:33:22.604153 4179 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:33:22.615061 4179 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8c65f0c512d94779953ead2c63597097: Generated new TSK 0
I20260811 07:33:22.616466 4179 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:33:22.622880 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36937
--builtin_ntp_servers=127.22.4.212:44751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 07:33:22.783897 4195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:22.784276 4195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:22.784368 4195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:22.789150 4195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:22.789256 4195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:22.789357 4195 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:33:22.795047 4195 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4195
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:22.796454 4195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:22.798043 4195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:22.810141 4209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:22.810199 4207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:22.810153 4205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:22.810564 4195 server_base.cc:1034] running on GCE node
I20260811 07:33:22.811269 4195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:22.812050 4195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:22.815424 4195 hybrid_clock.cc:648] HybridClock initialized: now 1786433602815345 us; error 82 us; skew 500 ppm
I20260811 07:33:22.818312 4195 webserver.cc:460] Webserver started at http://127.22.4.193:35657/ using document root <none> and password file <none>
I20260811 07:33:22.819248 4195 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:22.819605 4195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:22.820036 4195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:22.823825 4195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "e3e27c7cbd8e46cc9e8bbd2c2290b66d"
format_stamp: "Formatted at 2026-08-11 07:33:22 on dist-test-slave-7z32"
server_key: "3e6515333b8e760d30492372be8d1f09"
server_key_iv: "458800f1f9464aa840e30071442eb9e0"
server_key_version: "encryptionkey@0"
I20260811 07:33:22.824595 4195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "e3e27c7cbd8e46cc9e8bbd2c2290b66d"
format_stamp: "Formatted at 2026-08-11 07:33:22 on dist-test-slave-7z32"
server_key: "3e6515333b8e760d30492372be8d1f09"
server_key_iv: "458800f1f9464aa840e30071442eb9e0"
server_key_version: "encryptionkey@0"
I20260811 07:33:22.830062 4195 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:33:22.834620 4222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:22.836712 4195 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:33:22.836934 4195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "e3e27c7cbd8e46cc9e8bbd2c2290b66d"
format_stamp: "Formatted at 2026-08-11 07:33:22 on dist-test-slave-7z32"
server_key: "3e6515333b8e760d30492372be8d1f09"
server_key_iv: "458800f1f9464aa840e30071442eb9e0"
server_key_version: "encryptionkey@0"
I20260811 07:33:22.837102 4195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:22.856036 4195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:22.857190 4195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:22.857470 4195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:22.858242 4195 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:22.859499 4195 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:22.859579 4195 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:22.859647 4195 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:22.859697 4195 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:22.872733 4195 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:45123
I20260811 07:33:22.872785 4390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:45123 every 8 connection(s)
I20260811 07:33:22.873972 4195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:33:22.878621 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 4195
I20260811 07:33:22.878799 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:33:22.879303 22547 external_mini_cluster.cc:1428] Setting key 144f3f1911a45c271a63095894a73523
I20260811 07:33:22.883240 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36937
--builtin_ntp_servers=127.22.4.212:44751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 07:33:22.889891 4161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:22.876675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:55371 (local address 127.22.4.254:36937)
0811 07:33:22.876920 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:22.876927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:22.879068 (+ 2141us) server_negotiation.cc:407] Connection header received
0811 07:33:22.881577 (+ 2509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:22.881582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:22.881694 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:22.881826 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:22.884002 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.884938 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.886971 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.887313 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.887658 (+ 345us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:22.889230 (+ 1572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:22.889234 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:22.889237 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:33:22.889255 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:22.889278 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:33:22.889288 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:22.889384 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:22.889607 (+ 223us) server_negotiation.cc:299] Negotiation successful
0811 07:33:22.889708 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:33:22.891198 4397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:22.877335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36937 (local address 127.22.4.193:55371)
0811 07:33:22.878716 (+ 1381us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:22.878814 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:22.881076 (+ 2262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:22.882199 (+ 1123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:22.882216 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:22.882535 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:22.883746 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:22.883770 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.885177 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.885180 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:22.886684 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:22.886699 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:22.887720 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:22.887725 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:22.887959 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:22.888818 (+ 859us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:33:22.888820 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:22.888874 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:33:22.888968 (+ 94us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:22.889399 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:22.889413 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:22.889423 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:33:22.889586 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 07:33:22.889969 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":540,"thread_start_us":240,"threads_started":1}
I20260811 07:33:22.893146 4391 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36937
I20260811 07:33:22.893482 4391 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:22.894165 4391 heartbeater.cc:511] Master 127.22.4.254:36937 requested a full tablet report, sending...
I20260811 07:33:22.896366 4096 ts_manager.cc:194] Registered new tserver with Master: e3e27c7cbd8e46cc9e8bbd2c2290b66d (127.22.4.193:45123)
I20260811 07:33:22.897672 4096 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.193:55371
W20260811 07:33:23.039052 4398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:23.039428 4398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:23.039516 4398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:23.044842 4398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:23.044960 4398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:23.045063 4398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:33:23.050271 4398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:23.051772 4398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:23.053349 4398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:23.065517 4406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:23.065541 4404 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:23.065541 4410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:23.066028 4398 server_base.cc:1034] running on GCE node
I20260811 07:33:23.066736 4398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:23.067826 4398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:23.071209 4398 hybrid_clock.cc:648] HybridClock initialized: now 1786433603071159 us; error 61 us; skew 500 ppm
I20260811 07:33:23.074254 4398 webserver.cc:460] Webserver started at http://127.22.4.194:46067/ using document root <none> and password file <none>
I20260811 07:33:23.075065 4398 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:23.075179 4398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:23.075462 4398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:23.077800 4398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "c0a3c78b4e0e4fe9a74937c09b13a55e"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "0558af043f728ddd75507aa8853501a3"
server_key_iv: "c96a309e1555542738f949b56b5d717f"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.078482 4398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "c0a3c78b4e0e4fe9a74937c09b13a55e"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "0558af043f728ddd75507aa8853501a3"
server_key_iv: "c96a309e1555542738f949b56b5d717f"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.083530 4398 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260811 07:33:23.087435 4416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:23.089270 4398 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:33:23.089536 4398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "c0a3c78b4e0e4fe9a74937c09b13a55e"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "0558af043f728ddd75507aa8853501a3"
server_key_iv: "c96a309e1555542738f949b56b5d717f"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.089709 4398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:23.101969 4398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:23.102769 4398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:23.103031 4398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:23.103720 4398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:23.104964 4398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:23.105037 4398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:23.105108 4398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:23.105160 4398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:23.119130 4398 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:45721
I20260811 07:33:23.119191 4584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:45721 every 8 connection(s)
I20260811 07:33:23.120434 4398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:33:23.125454 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 4398
I20260811 07:33:23.125609 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:33:23.125962 22547 external_mini_cluster.cc:1428] Setting key 2f72852e1558a7f75f7a5082af1f2b89
I20260811 07:33:23.129621 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36937
--builtin_ntp_servers=127.22.4.212:44751
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 07:33:23.135954 4161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:23.123698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:48287 (local address 127.22.4.254:36937)
0811 07:33:23.123938 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:23.123955 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:23.126153 (+ 2198us) server_negotiation.cc:407] Connection header received
0811 07:33:23.128415 (+ 2262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:23.128420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:23.128515 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:23.128670 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:23.130402 (+ 1732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:23.131109 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:23.132900 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:23.133326 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:23.133505 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:23.135104 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:23.135112 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:23.135119 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:33:23.135145 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:23.135181 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:33:23.135195 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:23.135297 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:23.135571 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 07:33:23.135684 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 07:33:23.137049 4593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:23.124279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36937 (local address 127.22.4.194:48287)
0811 07:33:23.125844 (+ 1565us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:23.125933 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:23.128001 (+ 2068us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:23.128959 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:23.128972 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:23.129114 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:23.130125 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:23.130155 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:23.131297 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:23.131304 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:23.132684 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:23.132700 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:23.133575 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:23.133578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:23.133774 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:23.134634 (+ 860us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:33:23.134636 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:23.134687 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:33:23.134779 (+ 92us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:23.135375 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:23.135384 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:23.135390 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:33:23.135535 (+ 145us) client_negotiation.cc:240] Negotiation successful
0811 07:33:23.135839 (+ 304us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"thread_start_us":211,"threads_started":1}
I20260811 07:33:23.138960 4589 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36937
I20260811 07:33:23.139292 4589 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:23.139959 4589 heartbeater.cc:511] Master 127.22.4.254:36937 requested a full tablet report, sending...
I20260811 07:33:23.141687 4096 ts_manager.cc:194] Registered new tserver with Master: c0a3c78b4e0e4fe9a74937c09b13a55e (127.22.4.194:45721)
I20260811 07:33:23.142386 4096 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.194:48287
W20260811 07:33:23.304268 4594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:23.304724 4594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:23.304773 4594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:23.311185 4594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:23.311321 4594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:23.311395 4594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:33:23.318542 4594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44751
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36937
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4594
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:23.320413 4594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:23.322916 4594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:23.339232 4606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:23.339257 4599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:23.339232 4600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:23.339614 4594 server_base.cc:1034] running on GCE node
I20260811 07:33:23.340268 4594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:23.341238 4594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:23.342720 4594 hybrid_clock.cc:648] HybridClock initialized: now 1786433603342684 us; error 63 us; skew 500 ppm
I20260811 07:33:23.345559 4594 webserver.cc:460] Webserver started at http://127.22.4.195:45669/ using document root <none> and password file <none>
I20260811 07:33:23.346416 4594 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:23.346556 4594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:23.346941 4594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:23.349694 4594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "bddcdeca75774140a7fedba5a20d9233"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "3a6115bc347bcbbd3c08ee17777155b5"
server_key_iv: "f6b7d3ad4c8e6b3aa306fecc0d938d77"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.350468 4594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "bddcdeca75774140a7fedba5a20d9233"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "3a6115bc347bcbbd3c08ee17777155b5"
server_key_iv: "f6b7d3ad4c8e6b3aa306fecc0d938d77"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.355983 4594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:33:23.359766 4615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:23.361791 4594 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:33:23.362018 4594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "bddcdeca75774140a7fedba5a20d9233"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "3a6115bc347bcbbd3c08ee17777155b5"
server_key_iv: "f6b7d3ad4c8e6b3aa306fecc0d938d77"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.362191 4594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:23.379312 4594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:23.380486 4594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:23.380822 4594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:23.381623 4594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:23.382941 4594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:23.382999 4594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:23.383070 4594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:23.383111 4594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:23.395584 4594 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:46303
I20260811 07:33:23.395735 4778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:46303 every 8 connection(s)
I20260811 07:33:23.396917 4594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:33:23.403390 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 4594
I20260811 07:33:23.403563 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:33:23.403931 22547 external_mini_cluster.cc:1428] Setting key 104b3f961e51e1971622c43d5d5b7f9f
I20260811 07:33:23.410168 4161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:23.399862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:42815 (local address 127.22.4.254:36937)
0811 07:33:23.400127 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:23.400131 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:23.401588 (+ 1457us) server_negotiation.cc:407] Connection header received
0811 07:33:23.403551 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:23.403555 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:23.403630 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:23.403757 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:23.405231 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:23.406011 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:23.407686 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:23.407922 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:23.408078 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:23.409540 (+ 1462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:23.409543 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:23.409546 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:33:23.409562 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:23.409585 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:33:23.409594 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:23.409687 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:23.409872 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 07:33:23.409959 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 07:33:23.411592 4783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:23.400289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36937 (local address 127.22.4.195:42815)
0811 07:33:23.401365 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:23.401426 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:23.403249 (+ 1823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:23.404042 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:23.404057 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:23.404198 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:23.405058 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:23.405077 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:23.406159 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:23.406163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:23.407550 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:23.407562 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:23.408110 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:23.408114 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:23.408327 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:23.409161 (+ 834us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:33:23.409163 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:23.409225 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:33:23.409329 (+ 104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:23.409692 (+ 363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:23.409704 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:23.409714 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:33:23.409877 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 07:33:23.410307 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"thread_start_us":179,"threads_started":1}
I20260811 07:33:23.413261 4779 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36937
I20260811 07:33:23.413618 4779 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:23.414381 4779 heartbeater.cc:511] Master 127.22.4.254:36937 requested a full tablet report, sending...
I20260811 07:33:23.416234 4096 ts_manager.cc:194] Registered new tserver with Master: bddcdeca75774140a7fedba5a20d9233 (127.22.4.195:46303)
I20260811 07:33:23.416972 4096 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.195:42815
I20260811 07:33:23.420399 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:33:23.424783 4161 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:23.423398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46344 (local address 127.22.4.254:36937)
0811 07:33:23.423604 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:23.423610 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:23.423952 (+ 342us) server_negotiation.cc:407] Connection header received
0811 07:33:23.424075 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:23.424078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:23.424136 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:23.424221 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:23.424615 (+ 394us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46344: BlockingRecv error: recv got EOF from 127.0.0.1:46344 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 07:33:23.425274 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 4195
I20260811 07:33:23.443468 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 4398
I20260811 07:33:23.461155 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 4594
I20260811 07:33:23.496474 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 4053
2026-08-11T07:33:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (1253 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T07:33:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:33:23Z Disabled control of system clock
I20260811 07:33:23.548175 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:44053
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:40761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:44053
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:33:23.683714 4793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:23.684064 4793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:23.684105 4793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:23.688675 4793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:33:23.688768 4793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:23.688792 4793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:23.688810 4793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:33:23.688827 4793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:33:23.694156 4793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:44053
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:44053
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:23.695603 4793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:23.697296 4793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:23.709824 4805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:23.709824 4799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:23.709808 4800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:23.710425 4793 server_base.cc:1034] running on GCE node
I20260811 07:33:23.711997 4793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:23.715026 4793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:23.716554 4793 hybrid_clock.cc:648] HybridClock initialized: now 1786433603716496 us; error 93 us; skew 500 ppm
I20260811 07:33:23.720165 4793 webserver.cc:460] Webserver started at http://127.22.4.254:40905/ using document root <none> and password file <none>
I20260811 07:33:23.721055 4793 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:23.721143 4793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:23.721403 4793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:23.724603 4793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "69acca3f461b48679661e60f4503bdd9"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "82439c2d2d8ed9b255e1c164b000463b"
server_key_iv: "57314116c4d4b2ffa9ddd7b8b8c0ec78"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.725363 4793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "69acca3f461b48679661e60f4503bdd9"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "82439c2d2d8ed9b255e1c164b000463b"
server_key_iv: "57314116c4d4b2ffa9ddd7b8b8c0ec78"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.731251 4793 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260811 07:33:23.735553 4814 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:23.738024 4793 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:33:23.738329 4793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "69acca3f461b48679661e60f4503bdd9"
format_stamp: "Formatted at 2026-08-11 07:33:23 on dist-test-slave-7z32"
server_key: "82439c2d2d8ed9b255e1c164b000463b"
server_key_iv: "57314116c4d4b2ffa9ddd7b8b8c0ec78"
server_key_version: "encryptionkey@0"
I20260811 07:33:23.738539 4793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:23.746598 4793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:23.747802 4793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:23.748099 4793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:23.762814 4793 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:44053
I20260811 07:33:23.762814 4895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:44053 every 8 connection(s)
I20260811 07:33:23.765197 4793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:33:23.767920 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 4793
I20260811 07:33:23.768139 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:33:23.768553 22547 external_mini_cluster.cc:1428] Setting key a869b60707a4f3987fcbeb4e9a2a6c11
I20260811 07:33:23.770527 4897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:23.777876 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:23.770579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60330 (local address 127.22.4.254:44053)
0811 07:33:23.771853 (+ 1274us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:23.771887 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:23.771951 (+ 64us) server_negotiation.cc:407] Connection header received
0811 07:33:23.773104 (+ 1153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:23.773144 (+ 40us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:23.773842 (+ 698us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:23.774412 (+ 570us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:23.775815 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:23.775823 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:23.775843 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:33:23.775865 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:23.775953 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:33:23.775989 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:23.776245 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:23.776368 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 07:33:23.776764 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":262,"threads_started":1}
I20260811 07:33:23.780761 4897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9: Bootstrap starting.
I20260811 07:33:23.784255 4897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:23.785327 4897 log.cc:824] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:33:23.788630 4897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9: No bootstrap required, opened a new log
I20260811 07:33:23.794317 4897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69acca3f461b48679661e60f4503bdd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44053 } }
I20260811 07:33:23.794697 4897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:23.794759 4897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69acca3f461b48679661e60f4503bdd9, State: Initialized, Role: FOLLOWER
I20260811 07:33:23.796061 4897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69acca3f461b48679661e60f4503bdd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44053 } }
I20260811 07:33:23.796303 4897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:33:23.796384 4897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:33:23.796552 4897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:23.798032 4897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69acca3f461b48679661e60f4503bdd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44053 } }
I20260811 07:33:23.798568 4897 leader_election.cc:302] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69acca3f461b48679661e60f4503bdd9; no voters:
I20260811 07:33:23.799088 4897 leader_election.cc:288] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:33:23.799450 4903 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:33:23.799899 4903 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [term 1 LEADER]: Becoming Leader. State: Replica: 69acca3f461b48679661e60f4503bdd9, State: Running, Role: LEADER
I20260811 07:33:23.800511 4903 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69acca3f461b48679661e60f4503bdd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44053 } }
I20260811 07:33:23.801668 4897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:33:23.803381 4905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69acca3f461b48679661e60f4503bdd9. Latest consensus state: current_term: 1 leader_uuid: "69acca3f461b48679661e60f4503bdd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69acca3f461b48679661e60f4503bdd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44053 } } }
I20260811 07:33:23.803452 4904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69acca3f461b48679661e60f4503bdd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69acca3f461b48679661e60f4503bdd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44053 } } }
I20260811 07:33:23.803632 4904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:23.803629 4905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:23.804538 4916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:33:23.809357 4916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:33:23.820147 4916 catalog_manager.cc:1347] Generated new cluster ID: 09f1631e3c5d4cd7bdf25d29bf8bf343
I20260811 07:33:23.820308 4916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:33:23.835595 4916 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:33:23.836193 4916 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:33:23.847895 4916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69acca3f461b48679661e60f4503bdd9: Generated new TSK 0
I20260811 07:33:23.849170 4916 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:33:23.853940 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:44053
--builtin_ntp_servers=127.22.4.212:40761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 07:33:24.052886 4930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:24.053254 4930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:24.053301 4930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:24.057916 4930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:24.058270 4930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:24.058348 4930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:33:24.064985 4930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:44053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:24.066339 4930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:24.068534 4930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:24.082738 4944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:24.082746 4939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:24.083145 4940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:24.082945 4930 server_base.cc:1034] running on GCE node
I20260811 07:33:24.084045 4930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:24.085032 4930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:24.088495 4930 hybrid_clock.cc:648] HybridClock initialized: now 1786433604088450 us; error 76 us; skew 500 ppm
I20260811 07:33:24.091423 4930 webserver.cc:460] Webserver started at http://127.22.4.193:46435/ using document root <none> and password file <none>
I20260811 07:33:24.092219 4930 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:24.092330 4930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:24.092621 4930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:24.095220 4930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "0803ae82cca04e2e9bafa1d8c5f1025c"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "228acb7720cf708efcac0fbce50861b8"
server_key_iv: "1a433198b78eea6978800ad4a9b51e08"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.095938 4930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "0803ae82cca04e2e9bafa1d8c5f1025c"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "228acb7720cf708efcac0fbce50861b8"
server_key_iv: "1a433198b78eea6978800ad4a9b51e08"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.101471 4930 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:33:24.106050 4952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.109434 4930 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260811 07:33:24.109689 4930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "0803ae82cca04e2e9bafa1d8c5f1025c"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "228acb7720cf708efcac0fbce50861b8"
server_key_iv: "1a433198b78eea6978800ad4a9b51e08"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.109869 4930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:24.117059 4930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:24.118182 4930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:24.118742 4930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:24.119580 4930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:24.120817 4930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:24.120916 4930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.120991 4930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:24.121037 4930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.136706 4930 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:33091
I20260811 07:33:24.136834 5147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:33091 every 8 connection(s)
I20260811 07:33:24.137955 4930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:33:24.139551 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 4930
I20260811 07:33:24.139717 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:33:24.140108 22547 external_mini_cluster.cc:1428] Setting key 08a0e15d0ae55aa4d6862596cf224b92
I20260811 07:33:24.144611 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:44053
--builtin_ntp_servers=127.22.4.212:40761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 07:33:24.150098 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:24.141897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:48407 (local address 127.22.4.254:44053)
0811 07:33:24.142165 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:24.142172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:24.144863 (+ 2691us) server_negotiation.cc:407] Connection header received
0811 07:33:24.147332 (+ 2469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:24.147340 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:24.147422 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:24.147587 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:24.149333 (+ 1746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:24.149341 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:24.149348 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:33:24.149374 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:24.149413 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:33:24.149428 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:24.149568 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:24.149770 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 07:33:24.149841 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 07:33:24.151248 5151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:24.142998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:44053 (local address 127.22.4.193:48407)
0811 07:33:24.144609 (+ 1611us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:24.144699 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:24.146962 (+ 2263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:24.147896 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:24.147907 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:24.148040 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:24.148934 (+ 894us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:33:24.148936 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:24.148988 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:33:24.149088 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:24.149570 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:24.149579 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:24.149585 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:33:24.149788 (+ 203us) client_negotiation.cc:240] Negotiation successful
0811 07:33:24.150053 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":273,"threads_started":1}
I20260811 07:33:24.153236 5148 heartbeater.cc:347] Connected to a master server at 127.22.4.254:44053
I20260811 07:33:24.153602 5148 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:24.154193 5148 heartbeater.cc:511] Master 127.22.4.254:44053 requested a full tablet report, sending...
I20260811 07:33:24.156628 4839 ts_manager.cc:194] Registered new tserver with Master: 0803ae82cca04e2e9bafa1d8c5f1025c (127.22.4.193:33091)
W20260811 07:33:24.318054 5153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:24.318527 5153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:24.318579 5153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:24.323726 5153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:24.323846 5153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:24.323922 5153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:33:24.330507 5153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:44053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:24.332500 5153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:24.334560 5153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:24.351630 5162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:24.351805 5153 server_base.cc:1034] running on GCE node
W20260811 07:33:24.351653 5166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:24.351630 5163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:24.353271 5153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:24.354507 5153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:24.355888 5153 hybrid_clock.cc:648] HybridClock initialized: now 1786433604355833 us; error 79 us; skew 500 ppm
I20260811 07:33:24.359282 5153 webserver.cc:460] Webserver started at http://127.22.4.194:46011/ using document root <none> and password file <none>
I20260811 07:33:24.360728 5153 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:24.360858 5153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:24.361263 5153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:24.365464 5153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "5c356eb38fd649b08b2460e878569717"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "88bee8e2dc6cb8332a6d184976953c06"
server_key_iv: "343a77b79a29867e665270d56083067a"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.366641 5153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "5c356eb38fd649b08b2460e878569717"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "88bee8e2dc6cb8332a6d184976953c06"
server_key_iv: "343a77b79a29867e665270d56083067a"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.374619 5153 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260811 07:33:24.380043 5176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.382777 5153 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:33:24.383214 5153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "5c356eb38fd649b08b2460e878569717"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "88bee8e2dc6cb8332a6d184976953c06"
server_key_iv: "343a77b79a29867e665270d56083067a"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.383419 5153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:24.391449 5153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:24.392555 5153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:24.392848 5153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:24.393656 5153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:24.395162 5153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:24.395227 5153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.395282 5153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:24.395298 5153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.410463 5153 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:43369
I20260811 07:33:24.412343 5153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:33:24.413420 5346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:43369 every 8 connection(s)
I20260811 07:33:24.419389 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 5153
I20260811 07:33:24.419595 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:33:24.419919 22547 external_mini_cluster.cc:1428] Setting key a294c2c8f6469219004732635cbf162c
I20260811 07:33:24.422933 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:44053
--builtin_ntp_servers=127.22.4.212:40761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 07:33:24.423349 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:24.415486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:35515 (local address 127.22.4.254:44053)
0811 07:33:24.415731 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:24.415737 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:24.417693 (+ 1956us) server_negotiation.cc:407] Connection header received
0811 07:33:24.420382 (+ 2689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:24.420388 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:24.420469 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:24.420576 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:24.422375 (+ 1799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:24.422379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:24.422382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:33:24.422401 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:24.422431 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:33:24.422441 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:24.422558 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:24.422924 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 07:33:24.423007 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260811 07:33:24.424882 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:24.415987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:44053 (local address 127.22.4.194:35515)
0811 07:33:24.417405 (+ 1418us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:24.417506 (+ 101us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:24.419966 (+ 2460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:24.420844 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:24.420856 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:24.420999 (+ 143us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:24.421856 (+ 857us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:33:24.421858 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:24.421934 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:33:24.422074 (+ 140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:24.422576 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:24.422589 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:24.422599 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 07:33:24.422903 (+ 304us) client_negotiation.cc:240] Negotiation successful
0811 07:33:24.423360 (+ 457us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":237,"threads_started":1}
I20260811 07:33:24.427177 5347 heartbeater.cc:347] Connected to a master server at 127.22.4.254:44053
I20260811 07:33:24.427682 5347 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:24.428339 5347 heartbeater.cc:511] Master 127.22.4.254:44053 requested a full tablet report, sending...
I20260811 07:33:24.430073 4839 ts_manager.cc:194] Registered new tserver with Master: 5c356eb38fd649b08b2460e878569717 (127.22.4.194:43369)
W20260811 07:33:24.584467 5353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:24.585352 5353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:24.585502 5353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:24.593312 5353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:24.593446 5353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:24.593528 5353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:33:24.601989 5353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:44053
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:24.604075 5353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:24.607172 5353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:24.621548 5363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:24.621562 5360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:24.621548 5361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:24.622335 5353 server_base.cc:1034] running on GCE node
I20260811 07:33:24.623139 5353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:24.624351 5353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:24.627969 5353 hybrid_clock.cc:648] HybridClock initialized: now 1786433604627878 us; error 101 us; skew 500 ppm
I20260811 07:33:24.632238 5353 webserver.cc:460] Webserver started at http://127.22.4.195:46597/ using document root <none> and password file <none>
I20260811 07:33:24.633507 5353 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:24.633867 5353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:24.634286 5353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:24.638327 5353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "ca4aef7a494741e0a7bdf47c3f536cf2"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "1a5bb43badfd558df0efbad75e4995a8"
server_key_iv: "6602b7f10f3796653f7a2859a6d2e51f"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.639469 5353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "ca4aef7a494741e0a7bdf47c3f536cf2"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "1a5bb43badfd558df0efbad75e4995a8"
server_key_iv: "6602b7f10f3796653f7a2859a6d2e51f"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.647805 5353 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.007s sys 0.000s
I20260811 07:33:24.652567 5373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.655470 5353 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:33:24.655946 5353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "ca4aef7a494741e0a7bdf47c3f536cf2"
format_stamp: "Formatted at 2026-08-11 07:33:24 on dist-test-slave-7z32"
server_key: "1a5bb43badfd558df0efbad75e4995a8"
server_key_iv: "6602b7f10f3796653f7a2859a6d2e51f"
server_key_version: "encryptionkey@0"
I20260811 07:33:24.656201 5353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:24.664402 5353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:24.665494 5353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:24.665782 5353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:24.666993 5353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:24.668545 5353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:24.668648 5353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.668745 5353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:24.668800 5353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:24.684536 5353 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:42619
I20260811 07:33:24.684782 5554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:42619 every 8 connection(s)
I20260811 07:33:24.685968 5353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:33:24.687690 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 5353
I20260811 07:33:24.687839 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:33:24.688182 22547 external_mini_cluster.cc:1428] Setting key 30719e1187d77fa7dac590fd7463bf82
I20260811 07:33:24.697654 4901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:24.689197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:34849 (local address 127.22.4.254:44053)
0811 07:33:24.689367 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:24.689375 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:24.692165 (+ 2790us) server_negotiation.cc:407] Connection header received
0811 07:33:24.693870 (+ 1705us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:24.693874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:24.693941 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:24.694067 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:24.696731 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:24.696735 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:24.696739 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:33:24.696761 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:24.696795 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:33:24.696807 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:24.696942 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:24.697403 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 07:33:24.697475 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:33:24.698998 5558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:24.690233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:44053 (local address 127.22.4.195:34849)
0811 07:33:24.691834 (+ 1601us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:24.691960 (+ 126us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:24.693477 (+ 1517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:24.694542 (+ 1065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:24.694555 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:24.695140 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:24.696228 (+ 1088us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:33:24.696230 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:24.696293 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:33:24.696412 (+ 119us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:24.696990 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:24.697003 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:24.697011 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 07:33:24.697428 (+ 417us) client_negotiation.cc:240] Negotiation successful
0811 07:33:24.697730 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"thread_start_us":232,"threads_started":1}
I20260811 07:33:24.701591 5555 heartbeater.cc:347] Connected to a master server at 127.22.4.254:44053
I20260811 07:33:24.702098 5555 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:24.702781 5555 heartbeater.cc:511] Master 127.22.4.254:44053 requested a full tablet report, sending...
I20260811 07:33:24.709573 4838 ts_manager.cc:194] Registered new tserver with Master: ca4aef7a494741e0a7bdf47c3f536cf2 (127.22.4.195:42619)
I20260811 07:33:24.723748 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 07:33:24.728202 4901 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:33:24.726908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60340 (local address 127.22.4.254:44053)
0811 07:33:24.727112 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:24.727116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:24.727324 (+ 208us) server_negotiation.cc:407] Connection header received
0811 07:33:24.727463 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:24.727466 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:24.727517 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:24.727626 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:24.727987 (+ 361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60340: BlockingRecv error: recv got EOF from 127.0.0.1:60340 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:33:24.728847 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 4930
I20260811 07:33:24.763140 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 5153
I20260811 07:33:24.779101 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 5353
I20260811 07:33:24.802412 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 4793
2026-08-11T07:33:24Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (1310 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:33:24 dist-test-slave-7z32 krb5kdc[5567](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:33:24 dist-test-slave-7z32 krb5kdc[5567](info): set up 2 sockets
Aug 11 07:33:24 dist-test-slave-7z32 krb5kdc[5567](info): commencing operation
krb5kdc: starting...
W20260811 07:33:26.310597 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.465s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:33:26 dist-test-slave-7z32 krb5kdc[5567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:33:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:33:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:33:26.514083 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:36615
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:41071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:36615
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:26.664340 5589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:26.664731 5589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:26.664777 5589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:26.670608 5589 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:33:26.670732 5589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:26.670753 5589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:26.670773 5589 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:33:26.670789 5589 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:33:26.677209 5589 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:41071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:36615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:36615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:26.678524 5589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:26.679806 5589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:26.691082 5596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:26.691102 5594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:26.691160 5589 server_base.cc:1034] running on GCE node
W20260811 07:33:26.691171 5598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:26.692454 5589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:26.693840 5589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:26.695183 5589 hybrid_clock.cc:648] HybridClock initialized: now 1786433606695161 us; error 79 us; skew 500 ppm
Aug 11 07:33:26 dist-test-slave-7z32 krb5kdc[5567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433606, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:26.699210 5589 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:33:26.700506 5589 webserver.cc:460] Webserver started at http://127.22.4.254:41149/ using document root <none> and password file <none>
I20260811 07:33:26.701231 5589 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:26.701333 5589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:26.701611 5589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:26.704188 5589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "00298f1dfa214f14a5a99aae67031d3d"
format_stamp: "Formatted at 2026-08-11 07:33:26 on dist-test-slave-7z32"
server_key: "407bac115de66633aeb5e3f844196b2e"
server_key_iv: "f82d2ad4d2a03419a8acb4f94239aef4"
server_key_version: "encryptionkey@0"
I20260811 07:33:26.704891 5589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "00298f1dfa214f14a5a99aae67031d3d"
format_stamp: "Formatted at 2026-08-11 07:33:26 on dist-test-slave-7z32"
server_key: "407bac115de66633aeb5e3f844196b2e"
server_key_iv: "f82d2ad4d2a03419a8acb4f94239aef4"
server_key_version: "encryptionkey@0"
I20260811 07:33:26.709970 5589 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:33:26.713620 5608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:26.715833 5589 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:33:26.716053 5589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "00298f1dfa214f14a5a99aae67031d3d"
format_stamp: "Formatted at 2026-08-11 07:33:26 on dist-test-slave-7z32"
server_key: "407bac115de66633aeb5e3f844196b2e"
server_key_iv: "f82d2ad4d2a03419a8acb4f94239aef4"
server_key_version: "encryptionkey@0"
I20260811 07:33:26.716223 5589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:26.734117 5589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:26.738401 5589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:26.738616 5589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:26.747287 5589 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:36615
I20260811 07:33:26.747367 5686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:36615 every 8 connection(s)
I20260811 07:33:26.748540 5589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:33:26.753473 5687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:26.758229 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 5589
I20260811 07:33:26.758493 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:33:26.759083 22547 external_mini_cluster.cc:1428] Setting key 6a51863b77cc4c19849fc9d26e334104
I20260811 07:33:26.763917 5687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d: Bootstrap starting.
I20260811 07:33:26.768510 5687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:26.769807 5687 log.cc:824] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:33:26 dist-test-slave-7z32 krb5kdc[5567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433606, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:33:26.775286 5687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d: No bootstrap required, opened a new log
I20260811 07:33:26.781077 5687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00298f1dfa214f14a5a99aae67031d3d" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36615 } }
I20260811 07:33:26.781541 5687 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:26.781667 5687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00298f1dfa214f14a5a99aae67031d3d, State: Initialized, Role: FOLLOWER
I20260811 07:33:26.782493 5687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00298f1dfa214f14a5a99aae67031d3d" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36615 } }
I20260811 07:33:26.783025 5687 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:33:26.783246 5687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:33:26.783492 5687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:26.783812 5695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:26.761624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51518 (local address 127.22.4.254:36615)
0811 07:33:26.762267 (+ 643us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:26.762287 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:26.762338 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:33:26.763624 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:26.763656 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:26.764132 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:26.764592 (+ 460us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:26.765976 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:26.767378 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:26.768945 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:26.769796 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:26.770383 (+ 587us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:26.775647 (+ 5264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:26.775655 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:26.775699 (+ 44us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:26.775750 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:26.778434 (+ 2684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:26.779478 (+ 1044us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:26.779486 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:26.779494 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:26.779687 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:26.780112 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:26.780117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:26.780119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:26.780723 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:26.781475 (+ 752us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:26.781815 (+ 340us) server_negotiation.cc:299] Negotiation successful
0811 07:33:26.782592 (+ 777us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":213,"threads_started":1}
I20260811 07:33:26.785159 5687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00298f1dfa214f14a5a99aae67031d3d" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36615 } }
I20260811 07:33:26.785746 5687 leader_election.cc:302] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00298f1dfa214f14a5a99aae67031d3d; no voters:
I20260811 07:33:26.786285 5687 leader_election.cc:288] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:33:26.786412 5698 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:33:26.786666 5698 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [term 1 LEADER]: Becoming Leader. State: Replica: 00298f1dfa214f14a5a99aae67031d3d, State: Running, Role: LEADER
I20260811 07:33:26.787423 5698 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00298f1dfa214f14a5a99aae67031d3d" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36615 } }
I20260811 07:33:26.788885 5687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:33:26.790323 5699 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00298f1dfa214f14a5a99aae67031d3d. Latest consensus state: current_term: 1 leader_uuid: "00298f1dfa214f14a5a99aae67031d3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00298f1dfa214f14a5a99aae67031d3d" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36615 } } }
I20260811 07:33:26.790755 5699 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [sys.catalog]: This master's current role is: LEADER
I20260811 07:33:26.791946 5701 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00298f1dfa214f14a5a99aae67031d3d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00298f1dfa214f14a5a99aae67031d3d" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 36615 } } }
I20260811 07:33:26.792588 5701 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d [sys.catalog]: This master's current role is: LEADER
W20260811 07:33:26.800419 5723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:33:26.800603 5723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:33:26.800837 5708 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:33:26.802593 5708 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:33:26.813264 5708 catalog_manager.cc:1347] Generated new cluster ID: 88f8e93e5a9742828efdd66e2331389d
I20260811 07:33:26.813563 5708 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:33:26.836444 5708 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:33:26.838176 5708 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:33:26.849525 5708 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d: Generated new TSK 0
I20260811 07:33:26.851140 5708 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:33:26.913640 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36615
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:41071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:27.094086 5731 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:27.094553 5731 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:27.094616 5731 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:27.100064 5731 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:27.100171 5731 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:27.100237 5731 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:33:27.107775 5731 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:41071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5731
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:27.109807 5731 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:27.111251 5731 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:27.126339 5739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:27.126317 5738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:27.126304 5742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:27.126713 5731 server_base.cc:1034] running on GCE node
I20260811 07:33:27.127719 5731 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:27.128986 5731 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:27.130409 5731 hybrid_clock.cc:648] HybridClock initialized: now 1786433607130382 us; error 45 us; skew 500 ppm
Aug 11 07:33:27 dist-test-slave-7z32 krb5kdc[5567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433607, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:27.135226 5731 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:33:27.136799 5731 webserver.cc:460] Webserver started at http://127.22.4.193:38155/ using document root <none> and password file <none>
I20260811 07:33:27.137624 5731 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:27.137723 5731 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:27.137975 5731 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:27.141144 5731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "19099e70e34b4d14bd72b831214dc505"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "d9a6e65225964a7fe81c00a619b0a18c"
server_key_iv: "088c63aacf833f99115a559d429867f4"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.141980 5731 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "19099e70e34b4d14bd72b831214dc505"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "d9a6e65225964a7fe81c00a619b0a18c"
server_key_iv: "088c63aacf833f99115a559d429867f4"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.148404 5731 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 07:33:27.153050 5751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.155454 5731 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:33:27.155707 5731 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "19099e70e34b4d14bd72b831214dc505"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "d9a6e65225964a7fe81c00a619b0a18c"
server_key_iv: "088c63aacf833f99115a559d429867f4"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.155907 5731 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:27.179515 5731 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:27.185359 5731 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:27.185732 5731 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:27.186707 5731 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:27.188093 5731 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:27.188194 5731 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.188309 5731 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:27.188361 5731 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.204118 5731 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:39187
I20260811 07:33:27.204159 5918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:39187 every 8 connection(s)
I20260811 07:33:27.205515 5731 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:33:27.208752 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 5731
I20260811 07:33:27.208923 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:33:27.209321 22547 external_mini_cluster.cc:1428] Setting key f38ccc780fbc6055c2362a8c339a8ba6
Aug 11 07:33:27 dist-test-slave-7z32 krb5kdc[5567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433607, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:33:27.233479 5695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.208637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:59105 (local address 127.22.4.254:36615)
0811 07:33:27.208795 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:27.208800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:27.211015 (+ 2215us) server_negotiation.cc:407] Connection header received
0811 07:33:27.213115 (+ 2100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:27.213120 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:27.213211 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:27.213381 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:27.215980 (+ 2599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.217145 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.220324 (+ 3179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.220647 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.220819 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.225811 (+ 4992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:27.225817 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:27.225821 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:27.226002 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:27.228984 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:27.230380 (+ 1396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:27.230385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:27.230386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:27.230658 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:27.231441 (+ 783us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:27.231445 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:27.231446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:27.231804 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:27.231954 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:27.233008 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0811 07:33:27.233251 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:33:27.235025 5923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.209396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36615 (local address 127.22.4.193:59105)
0811 07:33:27.210681 (+ 1285us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:27.210863 (+ 182us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:27.212738 (+ 1875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:27.213889 (+ 1151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:27.213902 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:27.214754 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:27.215605 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.215633 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.217582 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.217589 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.219816 (+ 2227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.219846 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.221006 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.221014 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.221313 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.222392 (+ 1079us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:27.222422 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:27.225361 (+ 2939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:27.229315 (+ 3954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:27.229330 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:27.229370 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:27.230068 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:27.230931 (+ 863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:27.230934 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:27.230936 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:27.231228 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:27.231960 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:27.231972 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:27.232450 (+ 478us) client_negotiation.cc:769] Sending connection context
0811 07:33:27.232918 (+ 468us) client_negotiation.cc:240] Negotiation successful
0811 07:33:27.233464 (+ 546us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":261,"threads_started":1}
I20260811 07:33:27.237421 5919 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36615
I20260811 07:33:27.237859 5919 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:27.238723 5919 heartbeater.cc:511] Master 127.22.4.254:36615 requested a full tablet report, sending...
I20260811 07:33:27.241266 5631 ts_manager.cc:194] Registered new tserver with Master: 19099e70e34b4d14bd72b831214dc505 (127.22.4.193:39187)
I20260811 07:33:27.243321 5631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:59105
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:33:27.268728 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36615
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:41071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:27.428104 5926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:27.428504 5926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:27.428596 5926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:27.433024 5926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:27.433164 5926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:27.433274 5926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:33:27.439205 5926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:41071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5926
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:27.440548 5926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:27.441735 5926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:27.454106 5934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:27.453971 5937 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:27.453922 5933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:27.454386 5926 server_base.cc:1034] running on GCE node
I20260811 07:33:27.455219 5926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:27.456068 5926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:27.457625 5926 hybrid_clock.cc:648] HybridClock initialized: now 1786433607457600 us; error 43 us; skew 500 ppm
Aug 11 07:33:27 dist-test-slave-7z32 krb5kdc[5567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433607, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:27.462283 5926 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:33:27.463958 5926 webserver.cc:460] Webserver started at http://127.22.4.194:44405/ using document root <none> and password file <none>
I20260811 07:33:27.464872 5926 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:27.465093 5926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:27.465467 5926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:27.469193 5926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "207b13e7e8f44fd9b2eb21a27f22100c"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "feb226344d938a71ff78890208858ae3"
server_key_iv: "d31ef89f2663f92caf9ce6698e632909"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.470115 5926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "207b13e7e8f44fd9b2eb21a27f22100c"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "feb226344d938a71ff78890208858ae3"
server_key_iv: "d31ef89f2663f92caf9ce6698e632909"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.477070 5926 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260811 07:33:27.482921 5945 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.485093 5926 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:33:27.485351 5926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "207b13e7e8f44fd9b2eb21a27f22100c"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "feb226344d938a71ff78890208858ae3"
server_key_iv: "d31ef89f2663f92caf9ce6698e632909"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.485548 5926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:27.513438 5926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:27.518780 5926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:27.519256 5926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:27.520402 5926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:27.522325 5926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:27.522395 5926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.522459 5926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:27.522476 5926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.538983 5926 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:38421
I20260811 07:33:27.539178 6104 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:38421 every 8 connection(s)
I20260811 07:33:27.540434 5926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:33:27.544392 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 5926
I20260811 07:33:27.544569 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:33:27.544946 22547 external_mini_cluster.cc:1428] Setting key d4980c1e67b9a05bd552a32822afa0c9
Aug 11 07:33:27 dist-test-slave-7z32 krb5kdc[5567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433607, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:33:27.568598 5695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.543985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:33083 (local address 127.22.4.254:36615)
0811 07:33:27.544305 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:27.544313 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:27.546172 (+ 1859us) server_negotiation.cc:407] Connection header received
0811 07:33:27.549326 (+ 3154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:27.549331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:27.549419 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:27.549555 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:27.551820 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.552788 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.554468 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.555013 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.555221 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.561012 (+ 5791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:27.561020 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:27.561025 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:27.561162 (+ 137us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:27.564008 (+ 2846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:27.565131 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:27.565136 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:27.565138 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:27.565286 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:27.566203 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:27.566209 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:27.566211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:27.566576 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:27.566778 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:27.567759 (+ 981us) server_negotiation.cc:299] Negotiation successful
0811 07:33:27.568066 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260811 07:33:27.569532 6110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.544957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36615 (local address 127.22.4.194:33083)
0811 07:33:27.545921 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:27.546020 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:27.548728 (+ 2708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:27.549924 (+ 1196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:27.549954 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:27.550733 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:27.551539 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.551560 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.553106 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.553110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.554231 (+ 1121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.554250 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.555329 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.555334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.555573 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.557280 (+ 1707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:27.557304 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:27.560560 (+ 3256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:27.564293 (+ 3733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:27.564303 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:27.564325 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:27.564875 (+ 550us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:27.565514 (+ 639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:27.565518 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:27.565519 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:27.565743 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:27.566778 (+ 1035us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:27.566786 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:27.567272 (+ 486us) client_negotiation.cc:769] Sending connection context
0811 07:33:27.567521 (+ 249us) client_negotiation.cc:240] Negotiation successful
0811 07:33:27.568124 (+ 603us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":247,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:33:27.572762 6105 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36615
I20260811 07:33:27.573392 6105 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:27.574329 6105 heartbeater.cc:511] Master 127.22.4.254:36615 requested a full tablet report, sending...
I20260811 07:33:27.577039 5631 ts_manager.cc:194] Registered new tserver with Master: 207b13e7e8f44fd9b2eb21a27f22100c (127.22.4.194:38421)
I20260811 07:33:27.577867 5631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:33083
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:33:27.604534 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36615
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:41071
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:33:27.793179 6113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:33:27.793785 6113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:33:27.793921 6113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:33:27.799320 6113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:33:27.799463 6113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:33:27.799578 6113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:33:27.806519 6113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:41071
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:36615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:33:27.808332 6113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:33:27.809996 6113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:33:27.825011 6120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:27.825153 6119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:33:27.825153 6124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:33:27.825759 6113 server_base.cc:1034] running on GCE node
I20260811 07:33:27.826462 6113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:33:27.827327 6113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:33:27.828827 6113 hybrid_clock.cc:648] HybridClock initialized: now 1786433607828774 us; error 61 us; skew 500 ppm
Aug 11 07:33:27 dist-test-slave-7z32 krb5kdc[5567](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433607, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:33:27.832782 6113 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:33:27.834072 6113 webserver.cc:460] Webserver started at http://127.22.4.195:33259/ using document root <none> and password file <none>
I20260811 07:33:27.834923 6113 fs_manager.cc:359] Metadata directory not provided
I20260811 07:33:27.835041 6113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:33:27.835340 6113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:33:27.838161 6113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "2e0d119047f9494ab1a6c4ebfbf03046"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "0bf351993b4e06beb04e1a29d4dc90b9"
server_key_iv: "9ff867603dfcb50c9e1390fc55900ad2"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.839083 6113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "2e0d119047f9494ab1a6c4ebfbf03046"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "0bf351993b4e06beb04e1a29d4dc90b9"
server_key_iv: "9ff867603dfcb50c9e1390fc55900ad2"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.845332 6113 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 07:33:27.849874 6135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.851972 6113 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s
I20260811 07:33:27.852201 6113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "2e0d119047f9494ab1a6c4ebfbf03046"
format_stamp: "Formatted at 2026-08-11 07:33:27 on dist-test-slave-7z32"
server_key: "0bf351993b4e06beb04e1a29d4dc90b9"
server_key_iv: "9ff867603dfcb50c9e1390fc55900ad2"
server_key_version: "encryptionkey@0"
I20260811 07:33:27.852461 6113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:33:27.863934 6113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:33:27.869339 6113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:33:27.869562 6113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:33:27.870357 6113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:33:27.871629 6113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:33:27.871716 6113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.871794 6113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:33:27.871846 6113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:33:27.884940 6113 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:38419
I20260811 07:33:27.884982 6296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:38419 every 8 connection(s)
I20260811 07:33:27.886163 6113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:33:27.891070 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 6113
I20260811 07:33:27.891219 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:33:27.891642 22547 external_mini_cluster.cc:1428] Setting key 21d97bb311642c949a643003fef6ba93
Aug 11 07:33:27 dist-test-slave-7z32 krb5kdc[5567](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433607, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:33:27.907614 5695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.889384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:52481 (local address 127.22.4.254:36615)
0811 07:33:27.889606 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:27.889612 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:27.891144 (+ 1532us) server_negotiation.cc:407] Connection header received
0811 07:33:27.893684 (+ 2540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:27.893688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:27.893779 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:27.893867 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:27.895720 (+ 1853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.896334 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.897819 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.898078 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.898216 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.902509 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:27.902513 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:27.902516 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:27.902555 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:27.904477 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:27.905418 (+ 941us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:27.905421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:27.905423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:27.905519 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:27.905972 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:27.905976 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:27.905978 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:27.906252 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:27.906405 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:27.907226 (+ 821us) server_negotiation.cc:299] Negotiation successful
0811 07:33:27.907411 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:33:27.908972 6300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.889901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:36615 (local address 127.22.4.195:52481)
0811 07:33:27.890877 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:27.890975 (+ 98us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:27.893334 (+ 2359us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:27.894166 (+ 832us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:27.894178 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:27.894736 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:33:27.895502 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.895520 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.896503 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.896507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.897647 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.897660 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.898303 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.898308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.898717 (+ 409us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.899876 (+ 1159us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:33:27.899900 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:33:27.902151 (+ 2251us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:33:27.904784 (+ 2633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:27.904796 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:27.904822 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:27.905268 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:27.905652 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:33:27.905655 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:33:27.905656 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:33:27.905849 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:33:27.906406 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:33:27.906419 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:33:27.906814 (+ 395us) client_negotiation.cc:769] Sending connection context
0811 07:33:27.907167 (+ 353us) client_negotiation.cc:240] Negotiation successful
0811 07:33:27.907699 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":168,"threads_started":1}
I20260811 07:33:27.910802 6298 heartbeater.cc:347] Connected to a master server at 127.22.4.254:36615
I20260811 07:33:27.911314 6298 heartbeater.cc:464] Registering TS with master...
I20260811 07:33:27.912146 6298 heartbeater.cc:511] Master 127.22.4.254:36615 requested a full tablet report, sending...
I20260811 07:33:27.914248 5631 ts_manager.cc:194] Registered new tserver with Master: 2e0d119047f9494ab1a6c4ebfbf03046 (127.22.4.195:38419)
I20260811 07:33:27.915428 5631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:52481
I20260811 07:33:27.921842 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:33:27.936075 5695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.925430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51524 (local address 127.22.4.254:36615)
0811 07:33:27.925672 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:27.925678 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:27.925787 (+ 109us) server_negotiation.cc:407] Connection header received
0811 07:33:27.925931 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:27.925934 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:27.926005 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:27.926162 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:33:27.927314 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.928021 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.929203 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.929461 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.929585 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.931656 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:33:27.931660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:33:27.931663 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:33:27.931705 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:33:27.933619 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:27.934217 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:27.934220 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:27.934221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:27.934327 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:33:27.934729 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:33:27.934732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:33:27.934733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:33:27.935067 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:33:27.935193 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:27.935556 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 07:33:27.935837 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260811 07:33:27.940274 5631 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51524:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:33:27.944005 5631 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:33:27.967060 6317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.958361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33542 (local address 127.22.4.193:39187)
0811 07:33:27.958970 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:27.958980 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:27.959634 (+ 654us) server_negotiation.cc:407] Connection header received
0811 07:33:27.959996 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:27.960002 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:27.960253 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:27.960387 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:33:27.961204 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.962585 (+ 1381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.964848 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.965720 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.965892 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.966099 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:27.966649 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 07:33:27.966799 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":435,"thread_start_us":153,"threads_started":1}
I20260811 07:33:27.967106 6316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.958158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56182 (local address 127.22.4.195:38419)
0811 07:33:27.959209 (+ 1051us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:27.959225 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:27.960002 (+ 777us) server_negotiation.cc:407] Connection header received
0811 07:33:27.960225 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:27.960232 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:27.960428 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:27.960568 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:33:27.961347 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.962906 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.964832 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.965820 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.965972 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.966215 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:27.966680 (+ 465us) server_negotiation.cc:299] Negotiation successful
0811 07:33:27.966835 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":924,"thread_start_us":268,"threads_started":1}
I20260811 07:33:27.967134 6318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.958159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:38421 (local address 127.0.0.1:42370)
0811 07:33:27.959501 (+ 1342us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:27.959520 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:27.959745 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:27.960708 (+ 963us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:27.960716 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:27.960762 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:33:27.961117 (+ 355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.961127 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.963559 (+ 2432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.963564 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.964963 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.964985 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.966261 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.966266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.966553 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.966604 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 07:33:27.966696 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 07:33:27.966913 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1267,"mutex_wait_us":95,"spinlock_wait_cycles":2944,"thread_start_us":126,"threads_started":1}
I20260811 07:33:27.967870 6320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.959141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42370 (local address 127.22.4.194:38421)
0811 07:33:27.959635 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:27.959648 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:27.959674 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:33:27.960220 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:27.960227 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:27.960500 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:27.960711 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:33:27.961440 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.963342 (+ 1902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.965192 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.966108 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.966251 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.966399 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:27.967478 (+ 1079us) server_negotiation.cc:299] Negotiation successful
0811 07:33:27.967656 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":388,"thread_start_us":125,"threads_started":1}
I20260811 07:33:27.968035 6314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.958032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:38419 (local address 127.0.0.1:56182)
0811 07:33:27.959869 (+ 1837us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:27.959891 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:27.960079 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:27.960793 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:27.960798 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:27.960815 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:33:27.961069 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.961077 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.963092 (+ 2015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.963096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.964687 (+ 1591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.964699 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.966310 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.966316 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.966431 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.966471 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 07:33:27.967457 (+ 986us) client_negotiation.cc:240] Negotiation successful
0811 07:33:27.967582 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1741,"mutex_wait_us":1181,"spinlock_wait_cycles":15616,"thread_start_us":126,"threads_started":1}
I20260811 07:33:27.969817 6315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:27.958032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:39187 (local address 127.0.0.1:33542)
0811 07:33:27.959429 (+ 1397us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:27.959496 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:27.959756 (+ 260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:27.960708 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:27.960717 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:27.960766 (+ 49us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:33:27.961079 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.961085 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.962765 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.962770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.964543 (+ 1773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:27.964564 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:27.965909 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:27.965913 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:27.966083 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:27.966142 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 07:33:27.969545 (+ 3403us) client_negotiation.cc:240] Negotiation successful
0811 07:33:27.969663 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"mutex_wait_us":35,"spinlock_wait_cycles":17024,"thread_start_us":168,"threads_started":1}
I20260811 07:33:27.973500 6013 tablet_service.cc:1467] Processing CreateTablet for tablet 0d043d4623c045d28034345d50cbdedc (DEFAULT_TABLE table=test-table [id=0c64fa296db74caabc14943d83c7df26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:27.973762 5816 tablet_service.cc:1467] Processing CreateTablet for tablet 0d043d4623c045d28034345d50cbdedc (DEFAULT_TABLE table=test-table [id=0c64fa296db74caabc14943d83c7df26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:27.975178 6013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d043d4623c045d28034345d50cbdedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:27.975188 5816 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d043d4623c045d28034345d50cbdedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:27.976953 6202 tablet_service.cc:1467] Processing CreateTablet for tablet 0d043d4623c045d28034345d50cbdedc (DEFAULT_TABLE table=test-table [id=0c64fa296db74caabc14943d83c7df26]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:33:27.978727 6202 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d043d4623c045d28034345d50cbdedc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:33:27.985726 6322 tablet_bootstrap.cc:492] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Bootstrap starting.
I20260811 07:33:27.988888 6323 tablet_bootstrap.cc:492] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505: Bootstrap starting.
I20260811 07:33:27.990037 6324 tablet_bootstrap.cc:492] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Bootstrap starting.
I20260811 07:33:27.990302 6322 tablet_bootstrap.cc:654] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:27.992691 6322 log.cc:824] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:33:27.992998 6323 tablet_bootstrap.cc:654] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:27.994361 6323 log.cc:824] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505: Log is configured to *not* fsync() on all Append() calls
I20260811 07:33:27.995428 6324 tablet_bootstrap.cc:654] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Neither blocks nor log segments found. Creating new log.
I20260811 07:33:27.996820 6324 log.cc:824] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Log is configured to *not* fsync() on all Append() calls
I20260811 07:33:27.997648 6323 tablet_bootstrap.cc:492] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505: No bootstrap required, opened a new log
I20260811 07:33:27.997686 6322 tablet_bootstrap.cc:492] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: No bootstrap required, opened a new log
I20260811 07:33:27.997963 6323 ts_tablet_manager.cc:1397] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 07:33:27.998001 6322 ts_tablet_manager.cc:1397] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260811 07:33:28.000701 6324 tablet_bootstrap.cc:492] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: No bootstrap required, opened a new log
I20260811 07:33:28.001293 6324 ts_tablet_manager.cc:1397] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.004s
I20260811 07:33:28.003252 6323 raft_consensus.cc:348] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
I20260811 07:33:28.003630 6323 raft_consensus.cc:374] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:28.003720 6323 raft_consensus.cc:729] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19099e70e34b4d14bd72b831214dc505, State: Initialized, Role: FOLLOWER
I20260811 07:33:28.003669 6322 raft_consensus.cc:348] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
I20260811 07:33:28.004348 6323 consensus_queue.cc:260] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
I20260811 07:33:28.004735 6322 raft_consensus.cc:374] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:28.004868 6322 raft_consensus.cc:729] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 207b13e7e8f44fd9b2eb21a27f22100c, State: Initialized, Role: FOLLOWER
I20260811 07:33:28.005712 6323 ts_tablet_manager.cc:1428] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505: Time spent starting tablet: real 0.008s user 0.004s sys 0.005s
I20260811 07:33:28.005913 5919 heartbeater.cc:503] Master 127.22.4.254:36615 was elected leader, sending a full tablet report...
I20260811 07:33:28.006233 6322 consensus_queue.cc:260] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
I20260811 07:33:28.006652 6324 raft_consensus.cc:348] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
I20260811 07:33:28.007107 6324 raft_consensus.cc:374] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:33:28.007249 6324 raft_consensus.cc:729] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e0d119047f9494ab1a6c4ebfbf03046, State: Initialized, Role: FOLLOWER
I20260811 07:33:28.007844 6322 ts_tablet_manager.cc:1428] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Time spent starting tablet: real 0.010s user 0.009s sys 0.000s
I20260811 07:33:28.008160 6105 heartbeater.cc:503] Master 127.22.4.254:36615 was elected leader, sending a full tablet report...
I20260811 07:33:28.009606 6324 consensus_queue.cc:260] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
I20260811 07:33:28.011389 6324 ts_tablet_manager.cc:1428] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260811 07:33:28.011632 6298 heartbeater.cc:503] Master 127.22.4.254:36615 was elected leader, sending a full tablet report...
W20260811 07:33:28.042287 6109 tablet.cc:2369] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:33:28.135836 6331 raft_consensus.cc:482] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:33:28.136113 6331 raft_consensus.cc:504] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
W20260811 07:33:28.137516 6299 tablet.cc:2369] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:33:28.137547 6331 leader_election.cc:288] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 19099e70e34b4d14bd72b831214dc505 (127.22.4.193:39187), 207b13e7e8f44fd9b2eb21a27f22100c (127.22.4.194:38421)
I20260811 07:33:28.142282 6317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:28.138097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:41595 (local address 127.22.4.193:39187)
0811 07:33:28.138248 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:28.138252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:28.138286 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:33:28.138552 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:28.138556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:28.138615 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:28.138710 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:33:28.139082 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.139605 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.140795 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.141263 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.141722 (+ 459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:28.141791 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:28.142037 (+ 246us) server_negotiation.cc:299] Negotiation successful
0811 07:33:28.142124 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:33:28.142282 6300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:28.137893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:39187 (local address 127.22.4.195:41595)
0811 07:33:28.138139 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:28.138156 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:28.138348 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:28.138740 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:28.138743 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:28.138761 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:33:28.138946 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:28.138954 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.139744 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.139748 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:28.140642 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:28.140653 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.141723 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.141727 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:28.141864 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:28.141894 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:33:28.142010 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 07:33:28.142120 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143}
I20260811 07:33:28.142513 6335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:28.138043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:38421 (local address 127.22.4.195:45889)
0811 07:33:28.138768 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:28.138787 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:33:28.138997 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:33:28.139349 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:33:28.139352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:33:28.139368 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:33:28.139525 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:28.139531 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.140324 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.140327 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:28.141192 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:33:28.141201 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.141920 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.141924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:33:28.142045 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:28.142072 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:33:28.142173 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:33:28.142273 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":203,"threads_started":1}
I20260811 07:33:28.142489 6320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:28.138563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:45889 (local address 127.22.4.194:38421)
0811 07:33:28.138774 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:28.138782 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:28.138920 (+ 138us) server_negotiation.cc:407] Connection header received
0811 07:33:28.139135 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:28.139138 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:28.139230 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:28.139335 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:33:28.139640 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.140190 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.141330 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.141769 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.141921 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:28.141998 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:28.142195 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 07:33:28.142285 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260811 07:33:28.143446 5848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d043d4623c045d28034345d50cbdedc" candidate_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19099e70e34b4d14bd72b831214dc505" is_pre_election: true
I20260811 07:33:28.143549 6039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d043d4623c045d28034345d50cbdedc" candidate_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" is_pre_election: true
I20260811 07:33:28.143934 5848 raft_consensus.cc:2454] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e0d119047f9494ab1a6c4ebfbf03046 in term 0.
I20260811 07:33:28.144002 6039 raft_consensus.cc:2454] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2e0d119047f9494ab1a6c4ebfbf03046 in term 0.
I20260811 07:33:28.144670 6139 leader_election.cc:302] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19099e70e34b4d14bd72b831214dc505, 2e0d119047f9494ab1a6c4ebfbf03046; no voters:
I20260811 07:33:28.145123 6331 raft_consensus.cc:2781] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:33:28.145272 6331 raft_consensus.cc:482] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:33:28.145323 6331 raft_consensus.cc:3037] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:28.146647 6331 raft_consensus.cc:504] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
I20260811 07:33:28.147166 6331 leader_election.cc:288] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [CANDIDATE]: Term 1 election: Requested vote from peers 19099e70e34b4d14bd72b831214dc505 (127.22.4.193:39187), 207b13e7e8f44fd9b2eb21a27f22100c (127.22.4.194:38421)
I20260811 07:33:28.147743 6039 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d043d4623c045d28034345d50cbdedc" candidate_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "207b13e7e8f44fd9b2eb21a27f22100c"
I20260811 07:33:28.147847 5848 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d043d4623c045d28034345d50cbdedc" candidate_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19099e70e34b4d14bd72b831214dc505"
I20260811 07:33:28.147940 6039 raft_consensus.cc:3037] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:28.148115 5848 raft_consensus.cc:3037] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:33:28.149682 5848 raft_consensus.cc:2454] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e0d119047f9494ab1a6c4ebfbf03046 in term 1.
I20260811 07:33:28.150349 6039 raft_consensus.cc:2454] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2e0d119047f9494ab1a6c4ebfbf03046 in term 1.
I20260811 07:33:28.150444 6139 leader_election.cc:302] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19099e70e34b4d14bd72b831214dc505, 2e0d119047f9494ab1a6c4ebfbf03046; no voters:
I20260811 07:33:28.150928 6331 raft_consensus.cc:2781] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:33:28.151345 6331 raft_consensus.cc:686] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 1 LEADER]: Becoming Leader. State: Replica: 2e0d119047f9494ab1a6c4ebfbf03046, State: Running, Role: LEADER
I20260811 07:33:28.151854 6331 consensus_queue.cc:237] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } }
I20260811 07:33:28.157027 5631 catalog_manager.cc:5495] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2e0d119047f9494ab1a6c4ebfbf03046 (127.22.4.195). New cstate: current_term: 1 leader_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e0d119047f9494ab1a6c4ebfbf03046" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 } health_report { overall_health: UNKNOWN } } }
W20260811 07:33:28.207901 5920 tablet.cc:2369] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:33:28.217943 6316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:28.212837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56196 (local address 127.22.4.195:38419)
0811 07:33:28.213004 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:33:28.213009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:33:28.213066 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:33:28.213285 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:33:28.213288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:33:28.213352 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:33:28.213635 (+ 283us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:33:28.213978 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.214584 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.216050 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:33:28.216294 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:33:28.216396 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:33:28.216841 (+ 445us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:33:28.217377 (+ 536us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:33:28.217568 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 07:33:28.217712 (+ 144us) server_negotiation.cc:299] Negotiation successful
0811 07:33:28.217781 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:33:28.227733 5848 raft_consensus.cc:1261] T 0d043d4623c045d28034345d50cbdedc P 19099e70e34b4d14bd72b831214dc505 [term 1 FOLLOWER]: Refusing update from remote peer 2e0d119047f9494ab1a6c4ebfbf03046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:28.227784 6039 raft_consensus.cc:1261] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 1 FOLLOWER]: Refusing update from remote peer 2e0d119047f9494ab1a6c4ebfbf03046: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:33:28.228854 6337 consensus_queue.cc:1035] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "207b13e7e8f44fd9b2eb21a27f22100c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:28.229146 6331 consensus_queue.cc:1035] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19099e70e34b4d14bd72b831214dc505" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:33:28.241087 6345 mvcc.cc:205] Tried to move back new op lower bound from 7317232059287261184 to 7317232058994548736. Current Snapshot: MvccSnapshot[applied={T|T < 7317232059287261184}]
I20260811 07:33:28.255652 5626 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51524:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:33:28.255971 5626 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51524:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:33:28.260481 5626 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 00298f1dfa214f14a5a99aae67031d3d: Sending DeleteTablet for 3 replicas of tablet 0d043d4623c045d28034345d50cbdedc
I20260811 07:33:28.261941 5816 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d043d4623c045d28034345d50cbdedc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:28 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:33542
I20260811 07:33:28.262151 6202 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d043d4623c045d28034345d50cbdedc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:28 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:56182
I20260811 07:33:28.262750 6013 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d043d4623c045d28034345d50cbdedc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:33:28 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:42370
I20260811 07:33:28.263175 6361 tablet_replica.cc:330] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: stopping tablet replica
I20260811 07:33:28.263430 6368 tablet_replica.cc:330] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: stopping tablet replica
I20260811 07:33:28.263500 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 5731
I20260811 07:33:28.263770 6361 raft_consensus.cc:2229] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:33:28.263931 6368 raft_consensus.cc:2229] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:33:28.264295 6368 raft_consensus.cc:2258] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:28.265519 6361 raft_consensus.cc:2258] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:33:28.270368 6368 ts_tablet_manager.cc:1905] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:28.277565 6361 ts_tablet_manager.cc:1905] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:33:28.280557 6368 ts_tablet_manager.cc:1918] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:33:28.281224 6368 log.cc:1196] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/0d043d4623c045d28034345d50cbdedc
I20260811 07:33:28.281905 6368 ts_tablet_manager.cc:1939] T 0d043d4623c045d28034345d50cbdedc P 207b13e7e8f44fd9b2eb21a27f22100c: Deleting consensus metadata
I20260811 07:33:28.285259 5612 catalog_manager.cc:4841] TS 207b13e7e8f44fd9b2eb21a27f22100c (127.22.4.194:38421): tablet 0d043d4623c045d28034345d50cbdedc (table test-table [id=0c64fa296db74caabc14943d83c7df26]) successfully deleted
I20260811 07:33:28.286572 6361 ts_tablet_manager.cc:1918] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:33:28.286970 6361 log.cc:1196] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/0d043d4623c045d28034345d50cbdedc
I20260811 07:33:28.287540 6361 ts_tablet_manager.cc:1939] T 0d043d4623c045d28034345d50cbdedc P 2e0d119047f9494ab1a6c4ebfbf03046: Deleting consensus metadata
I20260811 07:33:28.289896 5611 catalog_manager.cc:4841] TS 2e0d119047f9494ab1a6c4ebfbf03046 (127.22.4.195:38419): tablet 0d043d4623c045d28034345d50cbdedc (table test-table [id=0c64fa296db74caabc14943d83c7df26]) successfully deleted
W20260811 07:33:28.295107 5613 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:39187 (error 108)
I20260811 07:33:28.296240 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 5926
I20260811 07:33:28.306380 6315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:33:28.296317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:39187 (local address 127.0.0.1:33552)
0811 07:33:28.306015 (+ 9698us) negotiation.cc:107] Waiting for socket to connect
0811 07:33:28.306203 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:39187: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9459}
W20260811 07:33:28.316805 5613 catalog_manager.cc:4584] TS 19099e70e34b4d14bd72b831214dc505 (127.22.4.193:39187): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0d043d4623c045d28034345d50cbdedc: Network error: Client connection negotiation failed: client connection to 127.22.4.193:39187: connect: Connection refused (error 111)
I20260811 07:33:28.324563 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 6113
I20260811 07:33:28.346143 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 5589
2026-08-11T07:33:28Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (3542 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:33:28 dist-test-slave-7z32 krb5kdc[6372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:33:28 dist-test-slave-7z32 krb5kdc[6372](info): set up 2 sockets
Aug 11 07:33:28 dist-test-slave-7z32 krb5kdc[6372](info): commencing operation
krb5kdc: starting...
W20260811 07:33:29.768908 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.381s user 0.011s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:33:29 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433609, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:33:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:33:29Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.4.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.4.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/rangeradmin_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/rangeradmin_127.22.4.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.4.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.4.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/rangerlookup_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/rangerlookup_127.22.4.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.4.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.4.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/HTTP_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/HTTP_127.22.4.212@KRBTEST.COM.keytab.
I20260811 07:33:30.041402 22547 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskV24Qp8/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/postgres -l logfile start
2026-08-11 07:33:34.098 UTC [6414] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 07:33:34.098 UTC [6414] LOG: listening on IPv4 address "127.22.4.212", port 36695
2026-08-11 07:33:34.103 UTC [6414] LOG: listening on Unix socket "/tmp/.s.PGSQL.36695"
2026-08-11 07:33:34.129 UTC [6417] LOG: database system was shut down at 2026-08-11 07:33:31 UTC
2026-08-11 07:33:34.135 UTC [6414] LOG: database system is ready to accept connections
I20260811 07:33:35.447510 22547 mini_postgres.cc:96] Postgres bound to 36695
2026-08-11 07:33:35.459 UTC [6430] FATAL: database "slave" does not exist
127.22.4.212:36695 - accepting connections
I20260811 07:33:35.460289 22547 mini_ranger.cc:161] Starting Ranger...
I20260811 07:33:35.488611 22547 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 07:33:36.490471 22547 mini_ranger.cc:87] Created ranger Postgres database
I20260811 07:33:36.490695 22547 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-admin
2026-08-11 07:33:36,889 [I] DB FLAVOR :POSTGRES
2026-08-11 07:33:36,890 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:33:36,890 [I] Checking connection..
2026-08-11 07:33:36,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 07:33:37,249 [I] Checking connection passed.
2026-08-11 07:33:37,250 [I] --------- Verifying version history table ---------
2026-08-11 07:33:37,250 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:33:37,612 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:33:37,612 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:33:37,990 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:33:37,990 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 07:33:37,991 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 07:33:38.386 UTC [6531] WARNING: there is no transaction in progress
2026-08-11 07:33:38,400 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 07:33:38,402 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:33:38,853 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 07:33:38,854 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:33:38,854 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 07:33:39,369 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 07:33:39,811 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7z32.c.gcp-upstream.internal','N') ;"
2026-08-11 07:33:40,268 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:33:40,732 [I] Table x_portal_user does not exist in database ranger
2026-08-11 07:33:40,732 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:33:41,218 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 07:33:41,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:33:41,632 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:33:42,039 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 07:33:42,039 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 07:33:43.696 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:43.741 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:43.782 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:43.810 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:43.840 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:43.869 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:43.975 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:43.993 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:44.038 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:44.063 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:44.087 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:44.114 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:44.135 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:44.150 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:44.169 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:44.189 UTC [6703] WARNING: there is no transaction in progress
2026-08-11 07:33:45,670 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 07:33:45,670 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 07:33:46,089 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 07:33:46,090 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:33:46,547 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 07:33:46,547 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:33:47,055 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 07:33:47,056 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:33:47,458 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:33:47,905 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7z32.c.gcp-upstream.internal';"
2026-08-11 07:33:48,302 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 07:33:48,303 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 07:33:48,707 [I] DB_PATCHES have already been applied
I20260811 07:33:48.722591 22547 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-admin:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskV24Qp8/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 07:33:48.722728 22547 mini_ranger.cc:193] Using host: 127.22.4.212
I20260811 07:33:48.738063 22547 mini_ranger.cc:227] Ranger admin URL: http://127.22.4.212:49533
Aug 11, 2026 7:33:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:33:49 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:33:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 7:33:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 7:33:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 7:33:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 7:33:50 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 07:33:52.411906 22547 mini_ranger.cc:160] Time spent starting Ranger: real 16.952s user 0.001s sys 0.028s
Aug 11, 2026 7:34:23 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:34:23 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 7:34:23 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:34:23 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:34:24 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 07:34:25.668923 22547 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.4.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.4.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/rangerkms_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/rangerkms_127.22.4.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.4.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.4.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.4.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/HTTP_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.4.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/HTTP_127.22.4.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 07:34:25 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433665, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 07:34:25.840723 22547 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 07:34:25.859066 22547 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 07:34:27.597535 22547 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 07:34:27.597681 22547 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms
I20260811 07:34:27.597810 22547 mini_ranger_kms.cc:227] Using postgres at 127.22.4.212:36695
2026-08-11 07:34:28,272 [I] DB FLAVOR :POSTGRES
2026-08-11 07:34:28,272 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:34:28,273 [I] Checking connection
2026-08-11 07:34:28,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 07:34:28,779 [I] connection success
2026-08-11 07:34:28,779 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 07:34:28,779 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 07:34:28,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 07:34:29,175 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 07:34:29,175 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:34:29,175 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 07:34:29,176 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:36695/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 07:34:29,605 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 07:34:30.440259 22547 mini_ranger_kms.cc:310] Created kms service
I20260811 07:34:30.781232 22547 mini_ranger_kms.cc:326] Created kudu user
I20260811 07:34:30.922767 22547 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 07:34:30 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433665, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:34:31.589435 22547 mini_ranger_kms.cc:384] Added ranger policy
I20260811 07:34:31.589671 22547 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms:/tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 07:34:31.589699 22547 mini_ranger_kms.cc:240] Using host: 127.22.4.212
I20260811 07:34:31.598448 22547 mini_ranger_kms.cc:276] Ranger KMS PID: 7001
I20260811 07:34:31.598927 22547 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.4.212:55511
Aug 11, 2026 7:34:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:34:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:34:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:34:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:34:34 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:34:34 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 07:34:35.427678 22547 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 9.587s user 0.003s sys 0.623s
I20260811 07:34:35.427929 22547 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 07:34:35.428179 22547 mini_ranger_kms.cc:401] 127.22.4.212:55511/kms/v1/keys
Aug 11 07:34:36 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433676, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.4.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 07:34:37 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433676, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.4.212@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
Aug 11 07:34:37 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433676, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.4.212@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
Aug 11 07:34:42 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:34:42.699501 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38465
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:38465
--ranger_config_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:55511/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:34:42.988101 7071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:34:42.988574 7071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:34:42.988668 7071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:34:42.998303 7071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:34:42.998543 7071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:34:42.998615 7071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:34:42.998677 7071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:34:42.998752 7071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:34:43.009871 7071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.4.212:55511/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:38465
--ranger_config_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:34:43.012118 7071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:34:43.014274 7071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:34:43.033763 7086 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:34:43.033771 7083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:34:43.034575 7071 server_base.cc:1034] running on GCE node
W20260811 07:34:43.034044 7082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:34:43.035866 7071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:34:43.038038 7071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:34:43.041559 7071 hybrid_clock.cc:648] HybridClock initialized: now 1786433683041490 us; error 107 us; skew 500 ppm
Aug 11 07:34:43 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:34:43.047299 7071 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:34:43.048799 7071 webserver.cc:460] Webserver started at http://127.22.4.254:34279/ using document root <none> and password file <none>
I20260811 07:34:43.049687 7071 fs_manager.cc:359] Metadata directory not provided
I20260811 07:34:43.049777 7071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:34:43.050068 7071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:34:43 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433683, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:34:43.144397 7071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "ddb2cd5242d041c2af22c347e69f5665"
format_stamp: "Formatted at 2026-08-11 07:34:43 on dist-test-slave-7z32"
server_key: "a4bcd9d68970d7c7a5bc66e04cdec512"
server_key_iv: "ccead8b1eddbc2a51e3d393b3760fdb2"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:43.146342 7071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "ddb2cd5242d041c2af22c347e69f5665"
format_stamp: "Formatted at 2026-08-11 07:34:43 on dist-test-slave-7z32"
server_key: "a4bcd9d68970d7c7a5bc66e04cdec512"
server_key_iv: "ccead8b1eddbc2a51e3d393b3760fdb2"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:43.158387 7071 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.008s sys 0.000s
I20260811 07:34:43.200222 7095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:43.205623 7071 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.009s sys 0.000s
I20260811 07:34:43.205996 7071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "ddb2cd5242d041c2af22c347e69f5665"
format_stamp: "Formatted at 2026-08-11 07:34:43 on dist-test-slave-7z32"
server_key: "a4bcd9d68970d7c7a5bc66e04cdec512"
server_key_iv: "ccead8b1eddbc2a51e3d393b3760fdb2"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:43.206267 7071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:34:43.249277 7071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:34:43.255867 7071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:34:43.256167 7071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:34:43.274654 7071 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:38465
I20260811 07:34:43.274966 7166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:38465 every 8 connection(s)
I20260811 07:34:43.277189 7071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:34:43.284174 7168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:34:43.287002 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 7071
I20260811 07:34:43.287168 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:34:43.287530 22547 external_mini_cluster.cc:1428] Setting key 8e96f3fca35afded8f964cca66f4ef38
I20260811 07:34:43.300828 7168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665: Bootstrap starting.
Aug 11 07:34:43 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:34:43.307245 7168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665: Neither blocks nor log segments found. Creating new log.
I20260811 07:34:43.310802 7168 log.cc:824] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665: Log is configured to *not* fsync() on all Append() calls
I20260811 07:34:43.315871 7168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665: No bootstrap required, opened a new log
I20260811 07:34:43.319967 7173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:43.289988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34876 (local address 127.22.4.254:38465)
0811 07:34:43.291510 (+ 1522us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:43.291643 (+ 133us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:43.291760 (+ 117us) server_negotiation.cc:407] Connection header received
0811 07:34:43.293098 (+ 1338us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:43.293130 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:43.293992 (+ 862us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:43.294644 (+ 652us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:34:43.297470 (+ 2826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:43.300500 (+ 3030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:43.302737 (+ 2237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:43.303622 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:43.303848 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:43.308420 (+ 4572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:34:43.308457 (+ 37us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:34:43.308518 (+ 61us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:34:43.308627 (+ 109us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:34:43.313852 (+ 5225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:43.314926 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:43.314937 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:43.314948 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:43.315185 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:43.315661 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:43.315665 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:43.315667 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:43.316541 (+ 874us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:34:43.316888 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:43.317500 (+ 612us) server_negotiation.cc:299] Negotiation successful
0811 07:34:43.317962 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":964,"thread_start_us":324,"threads_started":1}
I20260811 07:34:43.325006 7168 raft_consensus.cc:348] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb2cd5242d041c2af22c347e69f5665" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38465 } }
I20260811 07:34:43.325456 7168 raft_consensus.cc:374] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:34:43.325529 7168 raft_consensus.cc:729] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddb2cd5242d041c2af22c347e69f5665, State: Initialized, Role: FOLLOWER
I20260811 07:34:43.326333 7168 consensus_queue.cc:260] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb2cd5242d041c2af22c347e69f5665" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38465 } }
I20260811 07:34:43.326627 7168 raft_consensus.cc:388] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:34:43.326745 7168 raft_consensus.cc:482] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:34:43.326938 7168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:34:43.331441 7168 raft_consensus.cc:504] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb2cd5242d041c2af22c347e69f5665" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38465 } }
I20260811 07:34:43.332494 7168 leader_election.cc:302] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ddb2cd5242d041c2af22c347e69f5665; no voters:
I20260811 07:34:43.333482 7168 leader_election.cc:288] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:34:43.334097 7177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:34:43.334756 7177 raft_consensus.cc:686] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [term 1 LEADER]: Becoming Leader. State: Replica: ddb2cd5242d041c2af22c347e69f5665, State: Running, Role: LEADER
I20260811 07:34:43.335376 7177 consensus_queue.cc:237] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb2cd5242d041c2af22c347e69f5665" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38465 } }
I20260811 07:34:43.336323 7168 sys_catalog.cc:564] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:34:43.339349 7182 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ddb2cd5242d041c2af22c347e69f5665" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb2cd5242d041c2af22c347e69f5665" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38465 } } }
I20260811 07:34:43.339668 7182 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [sys.catalog]: This master's current role is: LEADER
I20260811 07:34:43.340112 7185 sys_catalog.cc:455] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ddb2cd5242d041c2af22c347e69f5665. Latest consensus state: current_term: 1 leader_uuid: "ddb2cd5242d041c2af22c347e69f5665" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ddb2cd5242d041c2af22c347e69f5665" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38465 } } }
I20260811 07:34:43.340304 7185 sys_catalog.cc:458] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665 [sys.catalog]: This master's current role is: LEADER
I20260811 07:34:43.342695 7196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:34:43.343098 7168 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:34:43.357043 7196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:34:43.370337 7196 catalog_manager.cc:1347] Generated new cluster ID: 534c15c57d2a4a60a456ca1c20783282
I20260811 07:34:43.370441 7196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:34:43.425972 7196 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:34:43.429562 7196 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:34:43.447141 7196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665: Generated new TSK 0
I20260811 07:34:43.449360 7196 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:34:45.040198 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:55511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38465
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:34:45.300127 7240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:34:45.300669 7240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:34:45.300791 7240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:34:45.307376 7240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:34:45.307524 7240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:34:45.307662 7240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:34:45.315600 7240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.4.212:55511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:34:45.317133 7240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:34:45.318493 7240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:34:45.335240 7252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:34:45.335454 7248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:34:45.335314 7249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:34:45.336288 7240 server_base.cc:1034] running on GCE node
I20260811 07:34:45.337011 7240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:34:45.338016 7240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:34:45.339241 7240 hybrid_clock.cc:648] HybridClock initialized: now 1786433685339184 us; error 94 us; skew 500 ppm
Aug 11 07:34:45 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433685, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:34:45.345690 7240 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:34:45.347888 7240 webserver.cc:460] Webserver started at http://127.22.4.193:33133/ using document root <none> and password file <none>
I20260811 07:34:45.349251 7240 fs_manager.cc:359] Metadata directory not provided
I20260811 07:34:45.349442 7240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:34:45.349860 7240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:34:45 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433685, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:34:45.373234 7240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "c90b96fac93d44369c2556634b9d139a"
format_stamp: "Formatted at 2026-08-11 07:34:45 on dist-test-slave-7z32"
server_key: "35a3bb967aaba0fbd707048f800b0373"
server_key_iv: "7e316291fd20a778841322ed61519ad6"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:45.373993 7240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "c90b96fac93d44369c2556634b9d139a"
format_stamp: "Formatted at 2026-08-11 07:34:45 on dist-test-slave-7z32"
server_key: "35a3bb967aaba0fbd707048f800b0373"
server_key_iv: "7e316291fd20a778841322ed61519ad6"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:45.379426 7240 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:34:45.399900 7261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:45.401633 7240 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:34:45.401816 7240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "c90b96fac93d44369c2556634b9d139a"
format_stamp: "Formatted at 2026-08-11 07:34:45 on dist-test-slave-7z32"
server_key: "35a3bb967aaba0fbd707048f800b0373"
server_key_iv: "7e316291fd20a778841322ed61519ad6"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:45.401993 7240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:34:45.442569 7240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:34:45.449988 7240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:34:45.450734 7240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:34:45.452072 7240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:34:45.453599 7240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:34:45.453681 7240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:45.453779 7240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:34:45.453828 7240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:45.496624 7240 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:38613
I20260811 07:34:45.499931 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 7240
I20260811 07:34:45.500177 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:34:45.500969 22547 external_mini_cluster.cc:1428] Setting key 1f8991bc50818ad1fd2d2ea5aa212959
I20260811 07:34:45.499413 7442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:38613 every 8 connection(s)
I20260811 07:34:45.499570 7240 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
Aug 11 07:34:45 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433685, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:34:45.550449 7449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:45.512945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:57919 (local address 127.22.4.254:38465)
0811 07:34:45.519207 (+ 6262us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:45.519216 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:45.519246 (+ 30us) server_negotiation.cc:407] Connection header received
0811 07:34:45.519323 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:45.519326 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:45.519554 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:45.522088 (+ 2534us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:34:45.522249 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:45.523286 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:45.527650 (+ 4364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:45.528130 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:45.528311 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:45.538123 (+ 9812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:34:45.538131 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:34:45.538149 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:34:45.538303 (+ 154us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:34:45.542990 (+ 4687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:45.545268 (+ 2278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:45.545274 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:45.545277 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:45.545551 (+ 274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:45.547167 (+ 1616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:45.547174 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:45.547176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:45.547768 (+ 592us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:34:45.548022 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:45.549614 (+ 1592us) server_negotiation.cc:299] Negotiation successful
0811 07:34:45.549937 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6096,"thread_start_us":275,"threads_started":1}
I20260811 07:34:45.551942 7447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:45.510231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38465 (local address 127.22.4.193:57919)
0811 07:34:45.515047 (+ 4816us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:45.515147 (+ 100us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:45.516929 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:45.520172 (+ 3243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:34:45.520193 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:34:45.520823 (+ 630us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:34:45.521820 (+ 997us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:45.521852 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:45.523699 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:45.523707 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:45.526499 (+ 2792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:45.526547 (+ 48us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:45.529286 (+ 2739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:45.529303 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:45.529994 (+ 691us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:45.532959 (+ 2965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:34:45.533028 (+ 69us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:34:45.537230 (+ 4202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:34:45.543571 (+ 6341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:34:45.543588 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:34:45.543630 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:34:45.544891 (+ 1261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:34:45.545840 (+ 949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:34:45.545844 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:34:45.545847 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:34:45.546790 (+ 943us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:34:45.548174 (+ 1384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:34:45.548278 (+ 104us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:34:45.549118 (+ 840us) client_negotiation.cc:769] Sending connection context
0811 07:34:45.549394 (+ 276us) client_negotiation.cc:240] Negotiation successful
0811 07:34:45.549870 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4189,"thread_start_us":278,"threads_started":1}
I20260811 07:34:45.554652 7443 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38465
I20260811 07:34:45.555104 7443 heartbeater.cc:464] Registering TS with master...
I20260811 07:34:45.555968 7443 heartbeater.cc:511] Master 127.22.4.254:38465 requested a full tablet report, sending...
I20260811 07:34:45.558468 7116 ts_manager.cc:194] Registered new tserver with Master: c90b96fac93d44369c2556634b9d139a (127.22.4.193:38613)
I20260811 07:34:45.561283 7116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:57919
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:34:45.593901 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:55511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38465
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:34:45 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433685, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:34:45.939468 7451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:34:45.939966 7451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:34:45.940032 7451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:34:45.950320 7451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:34:45.950487 7451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:34:45.950647 7451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:34:45.964988 7451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.4.212:55511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:34:45.968108 7451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:34:45.971305 7451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:34:45.997356 7462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:34:45.997421 7463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:34:45.998296 7466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:34:46.000329 7451 server_base.cc:1034] running on GCE node
I20260811 07:34:46.001183 7451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:34:46.002473 7451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:34:46.005931 7451 hybrid_clock.cc:648] HybridClock initialized: now 1786433686005854 us; error 101 us; skew 500 ppm
Aug 11 07:34:46 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433686, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:34:46.013444 7451 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:34:46.015514 7451 webserver.cc:460] Webserver started at http://127.22.4.194:42055/ using document root <none> and password file <none>
I20260811 07:34:46.016960 7451 fs_manager.cc:359] Metadata directory not provided
I20260811 07:34:46.017112 7451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:34:46.017527 7451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:34:46 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433686, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:34:46.056689 7451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "6c5ff4f9866143f6905815092158ae37"
format_stamp: "Formatted at 2026-08-11 07:34:46 on dist-test-slave-7z32"
server_key: "e2d52e3370df36de38591c8bf061d220"
server_key_iv: "c9a85852a6e549cdd83886a43c1bacc5"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:46.058527 7451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "6c5ff4f9866143f6905815092158ae37"
format_stamp: "Formatted at 2026-08-11 07:34:46 on dist-test-slave-7z32"
server_key: "e2d52e3370df36de38591c8bf061d220"
server_key_iv: "c9a85852a6e549cdd83886a43c1bacc5"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:46.068926 7451 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.007s sys 0.000s
I20260811 07:34:46.113263 7481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:46.117583 7451 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.002s sys 0.001s
I20260811 07:34:46.117913 7451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "6c5ff4f9866143f6905815092158ae37"
format_stamp: "Formatted at 2026-08-11 07:34:46 on dist-test-slave-7z32"
server_key: "e2d52e3370df36de38591c8bf061d220"
server_key_iv: "c9a85852a6e549cdd83886a43c1bacc5"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:46.118185 7451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:34:46.166782 7451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:34:46.172088 7451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:34:46.172390 7451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:34:46.173779 7451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:34:46.175474 7451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:34:46.175587 7451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:46.175659 7451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:34:46.175695 7451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:46.225898 7451 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:36441
I20260811 07:34:46.229605 7451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:34:46.230053 7656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:36441 every 8 connection(s)
I20260811 07:34:46.238493 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 7451
I20260811 07:34:46.238698 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:34:46.239380 22547 external_mini_cluster.cc:1428] Setting key c8ff04195af51cf4127336a1da4bf80a
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
Aug 11 07:34:46 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433686, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:34:46.280840 7661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:46.233616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:43155 (local address 127.22.4.254:38465)
0811 07:34:46.234068 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:46.234074 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:46.242150 (+ 8076us) server_negotiation.cc:407] Connection header received
0811 07:34:46.249633 (+ 7483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:46.249642 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:46.249765 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:46.249853 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:34:46.252929 (+ 3076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:46.253968 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:46.256422 (+ 2454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:46.256870 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:46.257069 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:46.267777 (+ 10708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:34:46.267783 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:34:46.267786 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:34:46.267836 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:34:46.271551 (+ 3715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:46.272845 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:46.272854 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:46.272858 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:46.273029 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:46.273650 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:46.273656 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:46.273661 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:46.274018 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:34:46.274129 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:46.280240 (+ 6111us) server_negotiation.cc:299] Negotiation successful
0811 07:34:46.280549 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":158,"threads_started":1}
I20260811 07:34:46.283087 7664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:46.234434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38465 (local address 127.22.4.194:43155)
0811 07:34:46.241278 (+ 6844us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:46.241972 (+ 694us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:46.248888 (+ 6916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:46.250489 (+ 1601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:34:46.250503 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:34:46.251315 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:34:46.252563 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:46.252604 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:46.254285 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:46.254295 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:46.256136 (+ 1841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:46.256162 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:46.258100 (+ 1938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:46.258113 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:46.258409 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:46.263373 (+ 4964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:34:46.263437 (+ 64us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:34:46.267251 (+ 3814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:34:46.271885 (+ 4634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:34:46.271901 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:34:46.271943 (+ 42us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:34:46.272640 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:34:46.273190 (+ 550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:34:46.273196 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:34:46.273201 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:34:46.273497 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:34:46.274227 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:34:46.274240 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:34:46.279688 (+ 5448us) client_negotiation.cc:769] Sending connection context
0811 07:34:46.280106 (+ 418us) client_negotiation.cc:240] Negotiation successful
0811 07:34:46.280729 (+ 623us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6234,"thread_start_us":416,"threads_started":1}
I20260811 07:34:46.286255 7657 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38465
I20260811 07:34:46.287514 7657 heartbeater.cc:464] Registering TS with master...
I20260811 07:34:46.289486 7657 heartbeater.cc:511] Master 127.22.4.254:38465 requested a full tablet report, sending...
I20260811 07:34:46.292583 7116 ts_manager.cc:194] Registered new tserver with Master: 6c5ff4f9866143f6905815092158ae37 (127.22.4.194:36441)
I20260811 07:34:46.295058 7116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:43155
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:34:46.321358 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:55511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38465
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:34:46.565502 7443 heartbeater.cc:503] Master 127.22.4.254:38465 was elected leader, sending a full tablet report...
W20260811 07:34:46.622053 7668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:34:46.622866 7668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:34:46.623030 7668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:34:46.631340 7668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:34:46.631768 7668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:34:46.632047 7668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:34:46.644181 7668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.4.212:55511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38465
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:34:46.647687 7668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:34:46.650259 7668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:34:46.673467 7676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:34:46.673467 7678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:34:46.676141 7668 server_base.cc:1034] running on GCE node
W20260811 07:34:46.676890 7675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:34:46.678025 7668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:34:46.679625 7668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:34:46.682938 7668 hybrid_clock.cc:648] HybridClock initialized: now 1786433686682828 us; error 137 us; skew 500 ppm
Aug 11 07:34:46 dist-test-slave-7z32 krb5kdc[6372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433686, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:34:46.688995 7668 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:34:46.691676 7668 webserver.cc:460] Webserver started at http://127.22.4.195:34689/ using document root <none> and password file <none>
I20260811 07:34:46.693344 7668 fs_manager.cc:359] Metadata directory not provided
I20260811 07:34:46.693543 7668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:34:46.693975 7668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:34:46 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433686, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:34:46.765538 7668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "20f0550bdd8648da98844cf81cdf90de"
format_stamp: "Formatted at 2026-08-11 07:34:46 on dist-test-slave-7z32"
server_key: "d0dd3f2845aab919f7122575d5c2e1bf"
server_key_iv: "c4000aa7432c7f5654da929450d7077a"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:46.769433 7668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "20f0550bdd8648da98844cf81cdf90de"
format_stamp: "Formatted at 2026-08-11 07:34:46 on dist-test-slave-7z32"
server_key: "d0dd3f2845aab919f7122575d5c2e1bf"
server_key_iv: "c4000aa7432c7f5654da929450d7077a"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:46.791961 7668 fs_manager.cc:691] Time spent creating directory manager: real 0.022s user 0.011s sys 0.000s
I20260811 07:34:46.843820 7687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:46.846642 7668 fs_manager.cc:725] Time spent opening block manager: real 0.013s user 0.004s sys 0.000s
I20260811 07:34:46.847113 7668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "20f0550bdd8648da98844cf81cdf90de"
format_stamp: "Formatted at 2026-08-11 07:34:46 on dist-test-slave-7z32"
server_key: "d0dd3f2845aab919f7122575d5c2e1bf"
server_key_iv: "c4000aa7432c7f5654da929450d7077a"
server_key_version: "kuduclusterkey@0"
I20260811 07:34:46.847430 7668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:34:46.880707 7668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:34:46.886366 7668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:34:46.886701 7668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:34:46.888041 7668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:34:46.889891 7668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:34:46.889982 7668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:34:46.890064 7668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:34:46.890100 7668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 07:34:46 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433685, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:34:46.923471 7668 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:43507
I20260811 07:34:46.925272 7668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:34:46.931967 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 7668
I20260811 07:34:46.932227 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:34:46.932713 22547 external_mini_cluster.cc:1428] Setting key faf715026f809333dd380f5fffe8cb95
I20260811 07:34:46.935212 7865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:43507 every 8 connection(s)
Aug 11 07:34:46 dist-test-slave-7z32 krb5kdc[6372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433686, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:34:47.002498 7871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:46.940797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:44669 (local address 127.22.4.254:38465)
0811 07:34:46.961735 (+ 20938us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:46.961741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:46.961760 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:34:46.961820 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:46.961823 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:46.961892 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:46.962006 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:34:46.975317 (+ 13311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:46.977176 (+ 1859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:46.983593 (+ 6417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:46.984280 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:46.984438 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:46.991204 (+ 6766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:34:46.991210 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:34:46.991214 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:34:46.991257 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:34:46.993647 (+ 2390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:46.996971 (+ 3324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:46.996981 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:46.996983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:46.997256 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:46.998290 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:46.998295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:46.998298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:46.998727 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:34:46.998896 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:47.002071 (+ 3175us) server_negotiation.cc:299] Negotiation successful
0811 07:34:47.002282 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20793,"thread_start_us":194,"threads_started":1}
I20260811 07:34:47.004154 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:46.938709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38465 (local address 127.22.4.195:44669)
0811 07:34:46.958681 (+ 19972us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:46.958889 (+ 208us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:46.960978 (+ 2089us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:46.966784 (+ 5806us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:34:46.966814 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:34:46.967615 (+ 801us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:34:46.968671 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:46.968704 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:46.977892 (+ 9188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:46.977897 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:46.980663 (+ 2766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:46.980696 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:46.984997 (+ 4301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:46.985003 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:46.985393 (+ 390us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:46.986621 (+ 1228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:34:46.986647 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:34:46.990678 (+ 4031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:34:46.993909 (+ 3231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:34:46.993920 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:34:46.993950 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:34:46.994795 (+ 845us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:34:46.997525 (+ 2730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:34:46.997529 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:34:46.997615 (+ 86us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:34:46.998085 (+ 470us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:34:46.999776 (+ 1691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:34:46.999791 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:34:47.000522 (+ 731us) client_negotiation.cc:769] Sending connection context
0811 07:34:47.000959 (+ 437us) client_negotiation.cc:240] Negotiation successful
0811 07:34:47.001804 (+ 845us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19396,"thread_start_us":287,"threads_started":1}
I20260811 07:34:47.006628 7868 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38465
I20260811 07:34:47.007120 7868 heartbeater.cc:464] Registering TS with master...
I20260811 07:34:47.008172 7868 heartbeater.cc:511] Master 127.22.4.254:38465 requested a full tablet report, sending...
I20260811 07:34:47.010627 7116 ts_manager.cc:194] Registered new tserver with Master: 20f0550bdd8648da98844cf81cdf90de (127.22.4.195:43507)
I20260811 07:34:47.011711 7116 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:44669
I20260811 07:34:47.021561 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:34:47.048733 7871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.030643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34888 (local address 127.22.4.254:38465)
0811 07:34:47.031321 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:47.031328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:47.032492 (+ 1164us) server_negotiation.cc:407] Connection header received
0811 07:34:47.032632 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:47.032637 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:47.032757 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:47.032903 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:34:47.034233 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.035463 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.038394 (+ 2931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.039051 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.039190 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.042825 (+ 3635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:34:47.042903 (+ 78us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:34:47.042909 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:34:47.042987 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:34:47.045586 (+ 2599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:47.046556 (+ 970us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:47.046561 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:47.046563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:47.046705 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:34:47.047186 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:34:47.047190 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:34:47.047193 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:34:47.047528 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:34:47.047722 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:47.048202 (+ 480us) server_negotiation.cc:299] Negotiation successful
0811 07:34:47.048438 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479}
I20260811 07:34:47.055310 7116 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34888:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:34:47.063819 7116 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:34:47.109023 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.087152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50672 (local address 127.22.4.195:43507)
0811 07:34:47.091971 (+ 4819us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:47.092026 (+ 55us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:47.093323 (+ 1297us) server_negotiation.cc:407] Connection header received
0811 07:34:47.093849 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:47.093857 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:47.096021 (+ 2164us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:47.096414 (+ 393us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:34:47.097251 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.100020 (+ 2769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.102628 (+ 2608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.106399 (+ 3771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.106602 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.106933 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:47.108241 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0811 07:34:47.108550 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4630,"thread_start_us":234,"threads_started":1}
I20260811 07:34:47.110204 7886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.086462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:43507 (local address 127.0.0.1:50672)
0811 07:34:47.092937 (+ 6475us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.093147 (+ 210us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:47.093511 (+ 364us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:47.096809 (+ 3298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:34:47.096819 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:34:47.096854 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:34:47.097060 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.097068 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.100218 (+ 3150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.100222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.102214 (+ 1992us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.102235 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.107089 (+ 4854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.107093 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.107470 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.107546 (+ 76us) client_negotiation.cc:769] Sending connection context
0811 07:34:47.107711 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 07:34:47.107899 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6093,"mutex_wait_us":74,"thread_start_us":276,"threads_started":1}
I20260811 07:34:47.115408 7891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.090112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:38613 (local address 127.0.0.1:37530)
0811 07:34:47.095975 (+ 5863us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.095994 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:47.096256 (+ 262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:47.097676 (+ 1420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:34:47.097681 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:34:47.097722 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:34:47.097920 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.097942 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.100263 (+ 2321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.100280 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.111728 (+ 11448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.111844 (+ 116us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.113907 (+ 2063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.113912 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.114051 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.114096 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 07:34:47.114186 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 07:34:47.115249 (+ 1063us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5742,"mutex_wait_us":1934,"thread_start_us":244,"threads_started":1}
I20260811 07:34:47.115378 7887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.089686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37530 (local address 127.22.4.193:38613)
0811 07:34:47.092357 (+ 2671us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:47.092364 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:47.096436 (+ 4072us) server_negotiation.cc:407] Connection header received
0811 07:34:47.096598 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:47.096609 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:47.097011 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:47.097307 (+ 296us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:34:47.098176 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.100019 (+ 1843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.112115 (+ 12096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.113419 (+ 1304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.113610 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.113822 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:47.114698 (+ 876us) server_negotiation.cc:299] Negotiation successful
0811 07:34:47.114882 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2530,"thread_start_us":96,"threads_started":1}
I20260811 07:34:47.116696 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.088815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36441 (local address 127.0.0.1:37210)
0811 07:34:47.095220 (+ 6405us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.095249 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:47.095500 (+ 251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:47.110729 (+ 15229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:34:47.110735 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:34:47.110778 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:34:47.111004 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.111013 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.113293 (+ 2280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.113298 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.114740 (+ 1442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.114755 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.116218 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.116224 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.116343 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.116373 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:34:47.116462 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:34:47.116555 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6236,"mutex_wait_us":6,"thread_start_us":198,"threads_started":1}
I20260811 07:34:47.116904 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.089531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37210 (local address 127.22.4.194:36441)
0811 07:34:47.109325 (+ 19794us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:47.109338 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:47.109395 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:34:47.109558 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:47.109570 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:47.110354 (+ 784us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:47.111252 (+ 898us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:34:47.111485 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.113061 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.114988 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.116005 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.116202 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.116418 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:47.116507 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 07:34:47.116653 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19339,"thread_start_us":297,"threads_started":1}
I20260811 07:34:47.117091 7754 tablet_service.cc:1467] Processing CreateTablet for tablet e024047d0c7c40908e2d579f857a2473 (DEFAULT_TABLE table=test-table [id=42bb1f89796448f282eea0f8f2c1a858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:34:47.119095 7754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e024047d0c7c40908e2d579f857a2473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:34:47.126284 7339 tablet_service.cc:1467] Processing CreateTablet for tablet e024047d0c7c40908e2d579f857a2473 (DEFAULT_TABLE table=test-table [id=42bb1f89796448f282eea0f8f2c1a858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:34:47.129566 7527 tablet_service.cc:1467] Processing CreateTablet for tablet e024047d0c7c40908e2d579f857a2473 (DEFAULT_TABLE table=test-table [id=42bb1f89796448f282eea0f8f2c1a858]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:34:47.131717 7527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e024047d0c7c40908e2d579f857a2473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:34:47.135517 7339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e024047d0c7c40908e2d579f857a2473. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:34:47.154603 7892 tablet_bootstrap.cc:492] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Bootstrap starting.
I20260811 07:34:47.159364 7893 tablet_bootstrap.cc:492] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a: Bootstrap starting.
I20260811 07:34:47.160504 7892 tablet_bootstrap.cc:654] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Neither blocks nor log segments found. Creating new log.
I20260811 07:34:47.161334 7894 tablet_bootstrap.cc:492] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: Bootstrap starting.
I20260811 07:34:47.162005 7892 log.cc:824] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Log is configured to *not* fsync() on all Append() calls
I20260811 07:34:47.165359 7892 tablet_bootstrap.cc:492] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: No bootstrap required, opened a new log
I20260811 07:34:47.165660 7892 ts_tablet_manager.cc:1397] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s
I20260811 07:34:47.167459 7893 tablet_bootstrap.cc:654] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a: Neither blocks nor log segments found. Creating new log.
I20260811 07:34:47.169170 7893 log.cc:824] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:34:47.169981 7894 tablet_bootstrap.cc:654] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: Neither blocks nor log segments found. Creating new log.
I20260811 07:34:47.171779 7894 log.cc:824] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: Log is configured to *not* fsync() on all Append() calls
I20260811 07:34:47.172441 7892 raft_consensus.cc:348] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
I20260811 07:34:47.172859 7892 raft_consensus.cc:374] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:34:47.172930 7892 raft_consensus.cc:729] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20f0550bdd8648da98844cf81cdf90de, State: Initialized, Role: FOLLOWER
I20260811 07:34:47.173663 7892 consensus_queue.cc:260] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
I20260811 07:34:47.175236 7892 ts_tablet_manager.cc:1428] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Time spent starting tablet: real 0.009s user 0.011s sys 0.001s
I20260811 07:34:47.175730 7868 heartbeater.cc:503] Master 127.22.4.254:38465 was elected leader, sending a full tablet report...
I20260811 07:34:47.177479 7893 tablet_bootstrap.cc:492] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a: No bootstrap required, opened a new log
I20260811 07:34:47.177853 7893 ts_tablet_manager.cc:1397] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.000s
I20260811 07:34:47.187824 7893 raft_consensus.cc:348] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
I20260811 07:34:47.188491 7893 raft_consensus.cc:374] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:34:47.188616 7893 raft_consensus.cc:729] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c90b96fac93d44369c2556634b9d139a, State: Initialized, Role: FOLLOWER
I20260811 07:34:47.189565 7893 consensus_queue.cc:260] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
I20260811 07:34:47.190508 7894 tablet_bootstrap.cc:492] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: No bootstrap required, opened a new log
I20260811 07:34:47.190779 7894 ts_tablet_manager.cc:1397] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.000s
I20260811 07:34:47.191497 7893 ts_tablet_manager.cc:1428] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260811 07:34:47.194872 7869 tablet.cc:2369] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:34:47.199992 7894 raft_consensus.cc:348] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
I20260811 07:34:47.200775 7894 raft_consensus.cc:374] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:34:47.200894 7894 raft_consensus.cc:729] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c5ff4f9866143f6905815092158ae37, State: Initialized, Role: FOLLOWER
I20260811 07:34:47.201699 7894 consensus_queue.cc:260] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
I20260811 07:34:47.203424 7894 ts_tablet_manager.cc:1428] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: Time spent starting tablet: real 0.013s user 0.011s sys 0.000s
I20260811 07:34:47.203981 7657 heartbeater.cc:503] Master 127.22.4.254:38465 was elected leader, sending a full tablet report...
I20260811 07:34:47.211876 7904 raft_consensus.cc:482] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:34:47.212208 7904 raft_consensus.cc:504] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
I20260811 07:34:47.213984 7904 leader_election.cc:288] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20f0550bdd8648da98844cf81cdf90de (127.22.4.195:43507), c90b96fac93d44369c2556634b9d139a (127.22.4.193:38613)
I20260811 07:34:47.224262 7887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.215395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:50145 (local address 127.22.4.193:38613)
0811 07:34:47.215623 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:47.215629 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:47.216745 (+ 1116us) server_negotiation.cc:407] Connection header received
0811 07:34:47.217017 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:47.217021 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:47.217094 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:47.217152 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:34:47.217855 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.218813 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.222162 (+ 3349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.222818 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.223017 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.223230 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:47.223887 (+ 657us) server_negotiation.cc:299] Negotiation successful
0811 07:34:47.224044 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260811 07:34:47.225174 7908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.214790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:38613 (local address 127.22.4.194:50145)
0811 07:34:47.216573 (+ 1783us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.216591 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:47.216864 (+ 273us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:47.217346 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:34:47.217349 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:34:47.217368 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:34:47.217682 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.217691 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.219038 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.219042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.221881 (+ 2839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.221914 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.223480 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.223485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.223670 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.223704 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:34:47.224756 (+ 1052us) client_negotiation.cc:240] Negotiation successful
0811 07:34:47.224910 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1679,"thread_start_us":470,"threads_started":1}
I20260811 07:34:47.226418 7375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e024047d0c7c40908e2d579f857a2473" candidate_uuid: "6c5ff4f9866143f6905815092158ae37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c90b96fac93d44369c2556634b9d139a" is_pre_election: true
I20260811 07:34:47.227044 7375 raft_consensus.cc:2454] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5ff4f9866143f6905815092158ae37 in term 0.
I20260811 07:34:47.227862 7487 leader_election.cc:302] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5ff4f9866143f6905815092158ae37, c90b96fac93d44369c2556634b9d139a; no voters:
I20260811 07:34:47.228168 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.215243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:46517 (local address 127.22.4.195:43507)
0811 07:34:47.215703 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:47.215710 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:47.216380 (+ 670us) server_negotiation.cc:407] Connection header received
0811 07:34:47.216638 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:47.216642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:47.216696 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:47.216761 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:34:47.218591 (+ 1830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.221368 (+ 2777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.225241 (+ 3873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.226297 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.226542 (+ 245us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.226611 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:47.227709 (+ 1098us) server_negotiation.cc:299] Negotiation successful
0811 07:34:47.227863 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350}
I20260811 07:34:47.228650 7906 raft_consensus.cc:2781] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:34:47.229316 7906 raft_consensus.cc:482] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:34:47.229454 7906 raft_consensus.cc:3037] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:34:47.233224 7906 raft_consensus.cc:504] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
W20260811 07:34:47.235478 7659 tablet.cc:2369] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:34:47.236941 7375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e024047d0c7c40908e2d579f857a2473" candidate_uuid: "6c5ff4f9866143f6905815092158ae37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c90b96fac93d44369c2556634b9d139a"
I20260811 07:34:47.237218 7375 raft_consensus.cc:3037] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:34:47.240362 7375 raft_consensus.cc:2454] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5ff4f9866143f6905815092158ae37 in term 1.
I20260811 07:34:47.241431 7487 leader_election.cc:302] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c5ff4f9866143f6905815092158ae37, c90b96fac93d44369c2556634b9d139a; no voters:
I20260811 07:34:47.242211 7904 raft_consensus.cc:2781] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:34:47.242699 7904 raft_consensus.cc:686] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 1 LEADER]: Becoming Leader. State: Replica: 6c5ff4f9866143f6905815092158ae37, State: Running, Role: LEADER
I20260811 07:34:47.243413 7904 consensus_queue.cc:237] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } }
I20260811 07:34:47.245759 7907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.214595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:43507 (local address 127.22.4.194:46517)
0811 07:34:47.216191 (+ 1596us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.216211 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:47.216494 (+ 283us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:47.217552 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:34:47.217556 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:34:47.217594 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:34:47.218352 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.218369 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.222268 (+ 3899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.222273 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.224929 (+ 2656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:34:47.224964 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.227050 (+ 2086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.227055 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:34:47.227238 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.227274 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:34:47.245295 (+ 18021us) client_negotiation.cc:240] Negotiation successful
0811 07:34:47.245488 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1499,"thread_start_us":969,"threads_started":1}
I20260811 07:34:47.249039 7790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e024047d0c7c40908e2d579f857a2473" candidate_uuid: "6c5ff4f9866143f6905815092158ae37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f0550bdd8648da98844cf81cdf90de" is_pre_election: true
I20260811 07:34:47.250051 7790 raft_consensus.cc:2454] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c5ff4f9866143f6905815092158ae37 in term 0.
I20260811 07:34:47.251053 7906 leader_election.cc:288] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [CANDIDATE]: Term 1 election: Requested vote from peers 20f0550bdd8648da98844cf81cdf90de (127.22.4.195:43507), c90b96fac93d44369c2556634b9d139a (127.22.4.193:38613)
I20260811 07:34:47.251184 7789 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e024047d0c7c40908e2d579f857a2473" candidate_uuid: "6c5ff4f9866143f6905815092158ae37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20f0550bdd8648da98844cf81cdf90de"
I20260811 07:34:47.251489 7789 raft_consensus.cc:3037] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:34:47.252055 7116 catalog_manager.cc:5495] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c5ff4f9866143f6905815092158ae37 (127.22.4.194). New cstate: current_term: 1 leader_uuid: "6c5ff4f9866143f6905815092158ae37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c5ff4f9866143f6905815092158ae37" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 36441 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260811 07:34:47.255035 7789 raft_consensus.cc:2454] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c5ff4f9866143f6905815092158ae37 in term 1.
W20260811 07:34:47.268440 7444 tablet.cc:2369] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:34:47.311960 7889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.304719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37220 (local address 127.22.4.194:36441)
0811 07:34:47.304946 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 07:34:47.304953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:34:47.304972 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:34:47.305143 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:34:47.305146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:34:47.305253 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:34:47.305415 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:34:47.306018 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.306953 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.308425 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:34:47.308800 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:34:47.308954 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:34:47.309648 (+ 694us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:34:47.310594 (+ 946us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:34:47.310799 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 07:34:47.311646 (+ 847us) server_negotiation.cc:299] Negotiation successful
0811 07:34:47.311748 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:34:47.326495 7375 raft_consensus.cc:1261] T e024047d0c7c40908e2d579f857a2473 P c90b96fac93d44369c2556634b9d139a [term 1 FOLLOWER]: Refusing update from remote peer 6c5ff4f9866143f6905815092158ae37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:34:47.327646 7789 raft_consensus.cc:1261] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 1 FOLLOWER]: Refusing update from remote peer 6c5ff4f9866143f6905815092158ae37: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:34:47.328981 7906 consensus_queue.cc:1035] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20f0550bdd8648da98844cf81cdf90de" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:34:47.336053 7906 consensus_queue.cc:1035] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c90b96fac93d44369c2556634b9d139a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:34:47.353160 7914 mvcc.cc:205] Tried to move back new op lower bound from 7317232383271071744 to 7317232382954184704. Current Snapshot: MvccSnapshot[applied={T|T < 7317232383271071744}]
I20260811 07:34:47.360076 7917 mvcc.cc:205] Tried to move back new op lower bound from 7317232383271071744 to 7317232382954184704. Current Snapshot: MvccSnapshot[applied={T|T < 7317232383271071744}]
I20260811 07:34:47.371965 7921 mvcc.cc:205] Tried to move back new op lower bound from 7317232383271071744 to 7317232382954184704. Current Snapshot: MvccSnapshot[applied={T|T < 7317232383271071744}]
I20260811 07:34:47.375056 7120 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:34:47.375396 7120 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34888:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:34:47.380918 7120 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ddb2cd5242d041c2af22c347e69f5665: Sending DeleteTablet for 3 replicas of tablet e024047d0c7c40908e2d579f857a2473
I20260811 07:34:47.383073 7754 tablet_service.cc:1514] Processing DeleteTablet for tablet e024047d0c7c40908e2d579f857a2473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:34:47 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:50672
I20260811 07:34:47.385236 7527 tablet_service.cc:1514] Processing DeleteTablet for tablet e024047d0c7c40908e2d579f857a2473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:34:47 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:37210
I20260811 07:34:47.386359 7930 tablet_replica.cc:330] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: stopping tablet replica
I20260811 07:34:47.387400 7339 tablet_service.cc:1514] Processing DeleteTablet for tablet e024047d0c7c40908e2d579f857a2473 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:34:47 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:37530
I20260811 07:34:47.387593 7930 raft_consensus.cc:2229] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:34:47.388362 7930 raft_consensus.cc:2258] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:34:47.388830 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 7240
I20260811 07:34:47.423193 7931 tablet_replica.cc:330] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: stopping tablet replica
I20260811 07:34:47.424098 7931 raft_consensus.cc:2229] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:34:47.427083 7931 raft_consensus.cc:2258] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:34:47.427675 7930 ts_tablet_manager.cc:1905] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:34:47.432631 7930 ts_tablet_manager.cc:1918] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:34:47.432838 7930 log.cc:1196] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/e024047d0c7c40908e2d579f857a2473
I20260811 07:34:47.433475 7930 ts_tablet_manager.cc:1939] T e024047d0c7c40908e2d579f857a2473 P 20f0550bdd8648da98844cf81cdf90de: Deleting consensus metadata
I20260811 07:34:47.435359 7931 ts_tablet_manager.cc:1905] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:34:47.447183 7931 ts_tablet_manager.cc:1918] T e024047d0c7c40908e2d579f857a2473 P 6c5ff4f9866143f6905815092158ae37: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260811 07:34:47.448966 7099 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:38613 (error 108)
I20260811 07:34:47.450941 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 7451
I20260811 07:34:47.462086 7102 catalog_manager.cc:4841] TS 20f0550bdd8648da98844cf81cdf90de (127.22.4.195:43507): tablet e024047d0c7c40908e2d579f857a2473 (table test-table [id=42bb1f89796448f282eea0f8f2c1a858]) successfully deleted
I20260811 07:34:47.467407 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.463774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:38613 (local address 127.0.0.1:37544)
0811 07:34:47.467114 (+ 3340us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.467272 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:38613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":3153}
W20260811 07:34:47.467809 7099 catalog_manager.cc:4584] TS c90b96fac93d44369c2556634b9d139a (127.22.4.193:38613): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e024047d0c7c40908e2d579f857a2473: Network error: Client connection negotiation failed: client connection to 127.22.4.193:38613: connect: Connection refused (error 111)
W20260811 07:34:47.477064 7884 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:34:47.476149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36441 (local address 127.0.0.1:37230)
0811 07:34:47.476399 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.476419 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:34:47.476599 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:34:47.476926 (+ 327us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.194:36441: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":154}
I20260811 07:34:47.478091 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 7668
I20260811 07:34:47.523595 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.522322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:38613 (local address 127.0.0.1:37552)
0811 07:34:47.523170 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.523312 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:38613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":654}
I20260811 07:34:47.526131 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.524093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36441 (local address 127.0.0.1:37244)
0811 07:34:47.525577 (+ 1484us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.525870 (+ 293us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.194:36441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1143}
I20260811 07:34:47.550029 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.531992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:38613 (local address 127.0.0.1:37556)
0811 07:34:47.549700 (+ 17708us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.549860 (+ 160us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:38613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17493}
I20260811 07:34:47.557618 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.556993 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:36441 (local address 127.0.0.1:37246)
0811 07:34:47.557388 (+ 395us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.557459 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.194:36441: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271}
I20260811 07:34:47.606947 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.605932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:38613 (local address 127.0.0.1:37572)
0811 07:34:47.606527 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.606723 (+ 196us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:38613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427}
I20260811 07:34:47.610649 7884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:34:47.609252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:38613 (local address 127.0.0.1:37588)
0811 07:34:47.609753 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 07:34:47.610190 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:38613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210}
I20260811 07:34:47.613958 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 7071
I20260811 07:34:47.639583 22547 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 07:34:48.021927 22547 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 07:34:48.022372 22547 mini_ranger.cc:66] Stopping Ranger...
I20260811 07:34:48.394634 22547 mini_ranger.cc:68] Stopped Ranger
2026-08-11 07:34:48.395 UTC [6414] LOG: received smart shutdown request
2026-08-11 07:34:48.401 UTC [6414] LOG: background worker "logical replication launcher" (PID 6426) exited with exit code 1
2026-08-11 07:34:48.402 UTC [6418] LOG: shutting down
2026-08-11 07:34:48.829 UTC [6414] LOG: database system is shut down
2026-08-11T07:34:48Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (80684 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:34:49 dist-test-slave-7z32 krb5kdc[7948](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:34:49 dist-test-slave-7z32 krb5kdc[7948](info): set up 2 sockets
Aug 11 07:34:49 dist-test-slave-7z32 krb5kdc[7948](info): commencing operation
krb5kdc: starting...
W20260811 07:34:50.800474 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.727s user 0.001s sys 0.015s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:34:50 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:34:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:34:50Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.22.4.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.22.4.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/rangeradmin_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/rangeradmin_127.22.4.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.22.4.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.22.4.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/rangerlookup_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/rangerlookup_127.22.4.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.4.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.22.4.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/HTTP_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/HTTP_127.22.4.212@KRBTEST.COM.keytab.
I20260811 07:34:51.144130 22547 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskV24Qp8/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/postgres -l logfile start
2026-08-11 07:34:57.391 UTC [7991] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 07:34:57.391 UTC [7991] LOG: listening on IPv4 address "127.22.4.212", port 47751
2026-08-11 07:34:57.397 UTC [7991] LOG: listening on Unix socket "/tmp/.s.PGSQL.47751"
2026-08-11 07:34:57.430 UTC [7996] LOG: database system was shut down at 2026-08-11 07:34:53 UTC
2026-08-11 07:34:57.436 UTC [7991] LOG: database system is ready to accept connections
I20260811 07:34:59.035254 22547 mini_postgres.cc:96] Postgres bound to 47751
2026-08-11 07:34:59.048 UTC [8008] FATAL: database "slave" does not exist
127.22.4.212:47751 - accepting connections
I20260811 07:34:59.049068 22547 mini_ranger.cc:161] Starting Ranger...
I20260811 07:34:59.079339 22547 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 07:35:00.358196 22547 mini_ranger.cc:87] Created ranger Postgres database
I20260811 07:35:00.358361 22547 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-admin
2026-08-11 07:35:00,831 [I] DB FLAVOR :POSTGRES
2026-08-11 07:35:00,832 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:35:00,832 [I] Checking connection..
2026-08-11 07:35:00,832 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 07:35:01,230 [I] Checking connection passed.
2026-08-11 07:35:01,231 [I] --------- Verifying version history table ---------
2026-08-11 07:35:01,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:35:01,615 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:35:01,616 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:35:02,030 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 07:35:02,031 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 07:35:02,031 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 07:35:02.426 UTC [8108] WARNING: there is no transaction in progress
2026-08-11 07:35:02,443 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 07:35:02,444 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 07:35:02,812 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 07:35:02,813 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:35:02,813 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 07:35:03,255 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 07:35:03,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7z32.c.gcp-upstream.internal','N') ;"
2026-08-11 07:35:03,998 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:35:04,372 [I] Table x_portal_user does not exist in database ranger
2026-08-11 07:35:04,372 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:35:04,699 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 07:35:04,699 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:35:05,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:35:05,392 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 07:35:05,393 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 07:35:06.952 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:06.985 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.016 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.050 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.082 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.107 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.189 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.202 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.226 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.246 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.266 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.289 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.304 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.314 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.327 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:07.340 UTC [8280] WARNING: there is no transaction in progress
2026-08-11 07:35:08,799 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 07:35:08,800 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 07:35:09,126 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 07:35:09,127 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 07:35:09,469 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 07:35:09,469 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 07:35:09,866 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 07:35:09,867 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 07:35:10,274 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 07:35:10,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7z32.c.gcp-upstream.internal';"
2026-08-11 07:35:10,933 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 07:35:10,933 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 07:35:11,279 [I] DB_PATCHES have already been applied
I20260811 07:35:11.288489 22547 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-admin:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskV24Qp8/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 07:35:11.288594 22547 mini_ranger.cc:193] Using host: 127.22.4.212
I20260811 07:35:11.295773 22547 mini_ranger.cc:227] Ranger admin URL: http://127.22.4.212:37013
Aug 11, 2026 7:35:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:35:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:35:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 7:35:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 7:35:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 7:35:12 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 7:35:12 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 07:35:13.001467 22547 mini_ranger.cc:160] Time spent starting Ranger: real 13.952s user 0.005s sys 0.018s
Aug 11, 2026 7:35:46 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 7:35:46 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 11, 2026 7:35:46 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 7:35:46 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 7:35:47 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 07:35:48.373971 22547 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.22.4.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.22.4.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/rangerkms_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.22.4.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/rangerkms_127.22.4.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.22.4.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.22.4.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.22.4.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/HTTP_127.22.4.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.22.4.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/HTTP_127.22.4.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 07:35:48 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433748, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 07:35:48.569967 22547 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 07:35:48.598553 22547 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 07:35:50.071920 22547 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 07:35:50.072048 22547 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms
I20260811 07:35:50.072069 22547 mini_ranger_kms.cc:227] Using postgres at 127.22.4.212:47751
2026-08-11 07:35:50,317 [I] DB FLAVOR :POSTGRES
2026-08-11 07:35:50,317 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 07:35:50,317 [I] Checking connection
2026-08-11 07:35:50,317 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 07:35:50,632 [I] connection success
2026-08-11 07:35:50,632 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 07:35:50,633 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 07:35:50,633 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 07:35:50,979 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 07:35:50,979 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 07:35:50,980 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 07:35:50,980 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.22.4.212:47751/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 07:35:51,334 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 07:35:52.136611 22547 mini_ranger_kms.cc:310] Created kms service
I20260811 07:35:52.403872 22547 mini_ranger_kms.cc:326] Created kudu user
I20260811 07:35:52.462621 22547 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 07:35:52 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433748, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:35:53.092176 22547 mini_ranger_kms.cc:384] Added ranger policy
I20260811 07:35:53.092764 22547 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms:/tmp/dist-test-taskV24Qp8/build/debug/bin/postgresql.jar:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskV24Qp8/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 07:35:53.092841 22547 mini_ranger_kms.cc:240] Using host: 127.22.4.212
I20260811 07:35:53.100956 22547 mini_ranger_kms.cc:276] Ranger KMS PID: 8578
I20260811 07:35:53.101277 22547 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.22.4.212:38805
Aug 11, 2026 7:35:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 7:35:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 7:35:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 7:35:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 7:35:55 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 7:35:55 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260811 07:35:56.598866 22547 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 8.029s user 0.006s sys 0.228s
I20260811 07:35:56.599072 22547 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 07:35:56.599181 22547 mini_ranger_kms.cc:401] 127.22.4.212:38805/kms/v1/keys
Aug 11 07:35:56 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433756, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.4.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 07:35:57 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433756, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.4.212@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
Aug 11 07:35:57 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433756, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.22.4.212@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
Aug 11 07:36:01 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:36:01.531061 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:32923
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:32923
--ranger_config_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:38805/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:01.713518 8647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:01.714088 8647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:01.714182 8647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:01.729224 8647 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:01.729354 8647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:01.729377 8647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:01.729395 8647 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:01.729418 8647 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:01.739516 8647 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
--ranger_kms_url=127.22.4.212:38805/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:32923
--ranger_config_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:32923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:01.742638 8647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:01.744563 8647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:01.757789 8658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:01.757861 8655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:01.757789 8656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:01.758387 8647 server_base.cc:1034] running on GCE node
I20260811 07:36:01.759449 8647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:01.761356 8647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:01.764801 8647 hybrid_clock.cc:648] HybridClock initialized: now 1786433761764684 us; error 134 us; skew 500 ppm
Aug 11 07:36:01 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433761, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:01.776448 8647 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:01.778417 8647 webserver.cc:460] Webserver started at http://127.22.4.254:43865/ using document root <none> and password file <none>
I20260811 07:36:01.779491 8647 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:01.779640 8647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:01.780050 8647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:36:01 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433761, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:01.874238 8647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "3911ca5ea2e3475ea2a00578ca03a930"
format_stamp: "Formatted at 2026-08-11 07:36:01 on dist-test-slave-7z32"
server_key: "105679ae7b732acaf05e0d3730f174fc"
server_key_iv: "f8bd87eebffc1bb9aa147f40c89e8e6b"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:01.875289 8647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "3911ca5ea2e3475ea2a00578ca03a930"
format_stamp: "Formatted at 2026-08-11 07:36:01 on dist-test-slave-7z32"
server_key: "105679ae7b732acaf05e0d3730f174fc"
server_key_iv: "f8bd87eebffc1bb9aa147f40c89e8e6b"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:01.882987 8647 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 07:36:01.916640 8668 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:01.920042 8647 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.004s
I20260811 07:36:01.920449 8647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "3911ca5ea2e3475ea2a00578ca03a930"
format_stamp: "Formatted at 2026-08-11 07:36:01 on dist-test-slave-7z32"
server_key: "105679ae7b732acaf05e0d3730f174fc"
server_key_iv: "f8bd87eebffc1bb9aa147f40c89e8e6b"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:01.920701 8647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:01.945958 8647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:01.951048 8647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:01.951406 8647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:01.965708 8647 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:32923
I20260811 07:36:01.965828 8756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:32923 every 8 connection(s)
I20260811 07:36:01.967351 8647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:01.971918 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 8647
I20260811 07:36:01.972126 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:36:01.972529 22547 external_mini_cluster.cc:1428] Setting key 3a7c5384515900e0da74271d1adb5ed6
I20260811 07:36:01.972780 8757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:01.983578 8757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Bootstrap starting.
I20260811 07:36:01.987196 8757 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:01.988353 8757 log.cc:824] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:36:01 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433761, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:01.992588 8757 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: No bootstrap required, opened a new log
I20260811 07:36:01.996650 8757 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } }
I20260811 07:36:01.996917 8763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:01.974796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33586 (local address 127.22.4.254:32923)
0811 07:36:01.975558 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:01.975581 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:01.975640 (+ 59us) server_negotiation.cc:407] Connection header received
0811 07:36:01.977207 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:01.977245 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:01.977866 (+ 621us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:01.978450 (+ 584us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:01.979823 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:01.981631 (+ 1808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:01.983966 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:01.985116 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:01.985624 (+ 508us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:01.989742 (+ 4118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:01.989751 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:01.989782 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:01.989832 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:01.992771 (+ 2939us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:01.993482 (+ 711us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:01.993490 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:01.993498 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:01.993729 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:01.994074 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:01.994078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:01.994080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:01.994702 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:01.995044 (+ 342us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:01.995395 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 07:36:01.995809 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":449,"thread_start_us":191,"threads_started":1}
I20260811 07:36:01.996981 8757 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:01.997078 8757 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3911ca5ea2e3475ea2a00578ca03a930, State: Initialized, Role: FOLLOWER
I20260811 07:36:01.997671 8757 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } }
I20260811 07:36:01.997861 8757 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:36:01.997979 8757 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:36:01.998121 8757 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:01.999536 8757 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } }
I20260811 07:36:02.000234 8757 leader_election.cc:302] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3911ca5ea2e3475ea2a00578ca03a930; no voters:
I20260811 07:36:02.001233 8757 leader_election.cc:288] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:36:02.001403 8766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:02.001906 8766 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 1 LEADER]: Becoming Leader. State: Replica: 3911ca5ea2e3475ea2a00578ca03a930, State: Running, Role: LEADER
I20260811 07:36:02.002452 8766 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } }
I20260811 07:36:02.003834 8757 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:02.005857 8770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3911ca5ea2e3475ea2a00578ca03a930" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } } }
I20260811 07:36:02.006172 8770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:02.005831 8767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3911ca5ea2e3475ea2a00578ca03a930. Latest consensus state: current_term: 1 leader_uuid: "3911ca5ea2e3475ea2a00578ca03a930" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } } }
I20260811 07:36:02.006289 8767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:02.006875 8791 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:02.007653 8757 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:36:02.016738 8791 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:02.034313 8791 catalog_manager.cc:1347] Generated new cluster ID: 67544ed490cd40bba247c77a37612468
I20260811 07:36:02.034664 8791 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:36:02.083472 8791 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:36:02.085237 8791 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:36:02.093541 8791 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Generated new TSK 0
I20260811 07:36:02.095106 8791 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:36:02.951869 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:38805/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:32923
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:03.124764 8831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:03.125146 8831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:03.125200 8831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:03.132179 8831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:03.132413 8831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:03.132545 8831 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:36:03.141301 8831 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.22.4.212:38805/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:03.143121 8831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:03.144399 8831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:03.156046 8849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:03.156046 8847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:03.157176 8846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:03.157809 8831 server_base.cc:1034] running on GCE node
I20260811 07:36:03.159101 8831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:03.160887 8831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:03.162199 8831 hybrid_clock.cc:648] HybridClock initialized: now 1786433763162141 us; error 78 us; skew 500 ppm
Aug 11 07:36:03 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433763, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:03.167909 8831 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:36:03.169512 8831 webserver.cc:460] Webserver started at http://127.22.4.193:33235/ using document root <none> and password file <none>
I20260811 07:36:03.170599 8831 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:03.170729 8831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:03.171082 8831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:36:03 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433763, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:03.194804 8831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "5c887459f34244cf857bf4a54ed94794"
format_stamp: "Formatted at 2026-08-11 07:36:03 on dist-test-slave-7z32"
server_key: "b002000415c6a0bfebf74a82f5d89668"
server_key_iv: "f04175afcff24b7f2e555f445f81c33b"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:03.195724 8831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "5c887459f34244cf857bf4a54ed94794"
format_stamp: "Formatted at 2026-08-11 07:36:03 on dist-test-slave-7z32"
server_key: "b002000415c6a0bfebf74a82f5d89668"
server_key_iv: "f04175afcff24b7f2e555f445f81c33b"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:03.202013 8831 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260811 07:36:03.238458 8859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:03.240478 8831 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.000s
I20260811 07:36:03.240660 8831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "5c887459f34244cf857bf4a54ed94794"
format_stamp: "Formatted at 2026-08-11 07:36:03 on dist-test-slave-7z32"
server_key: "b002000415c6a0bfebf74a82f5d89668"
server_key_iv: "f04175afcff24b7f2e555f445f81c33b"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:03.240862 8831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:03.277896 8831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:03.282243 8831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:03.282493 8831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:03.283692 8831 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:03.285310 8831 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:03.285423 8831 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:03.285499 8831 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:03.285533 8831 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:03.299453 8831 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:35109
I20260811 07:36:03.300242 9028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:35109 every 8 connection(s)
I20260811 07:36:03.300945 8831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:36:03.309880 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 8831
I20260811 07:36:03.310091 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:36:03.310498 22547 external_mini_cluster.cc:1428] Setting key 9a282a2e3fec8a95c1dd60a8dff2bc42
Aug 11 07:36:03 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433763, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:03.324409 9033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:03.304768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:32923 (local address 127.22.4.193:49861)
0811 07:36:03.306622 (+ 1854us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:03.306692 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:03.307917 (+ 1225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:03.308825 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:03.308837 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:03.309252 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:03.310045 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:03.310068 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:03.311520 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:03.311524 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:03.313095 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:03.313110 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:03.314042 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:03.314045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:03.314275 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:03.315126 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:03.315149 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:03.317244 (+ 2095us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:03.320210 (+ 2966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:03.320219 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:03.320244 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:03.320723 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:03.321200 (+ 477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:03.321204 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:03.321206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:03.321445 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:03.322051 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:03.322059 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:03.322466 (+ 407us) client_negotiation.cc:769] Sending connection context
0811 07:36:03.322717 (+ 251us) client_negotiation.cc:240] Negotiation successful
0811 07:36:03.323184 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1573,"thread_start_us":223,"threads_started":1}
I20260811 07:36:03.325520 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:03.304244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:49861 (local address 127.22.4.254:32923)
0811 07:36:03.304702 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:03.304708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:03.306889 (+ 2181us) server_negotiation.cc:407] Connection header received
0811 07:36:03.308277 (+ 1388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:03.308283 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:03.308390 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:03.308566 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:03.310314 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:03.311323 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:03.313308 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:03.313704 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:03.313813 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:03.317587 (+ 3774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:03.317593 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:03.317597 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:03.317653 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:03.319971 (+ 2318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:03.320910 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:03.320916 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:03.320918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:03.321069 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:03.321579 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:03.321583 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:03.321585 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:03.321875 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:03.321988 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:03.325122 (+ 3134us) server_negotiation.cc:299] Negotiation successful
0811 07:36:03.325327 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":148,"threads_started":1}
I20260811 07:36:03.327241 9030 heartbeater.cc:347] Connected to a master server at 127.22.4.254:32923
I20260811 07:36:03.327781 9030 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:03.328790 9030 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:36:03.331808 8698 ts_manager.cc:194] Registered new tserver with Master: 5c887459f34244cf857bf4a54ed94794 (127.22.4.193:35109)
I20260811 07:36:03.333757 8698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:49861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:36:03.364507 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:38805/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:32923
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:36:03 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433763, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:36:03.550168 9038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:03.550783 9038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:03.550884 9038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:03.557747 9038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:03.557897 9038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:03.558187 9038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:36:03.571350 9038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.22.4.212:38805/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:03.573724 9038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:03.575639 9038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:03.594925 9054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:03.595363 9057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:03.594941 9052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:03.597002 9038 server_base.cc:1034] running on GCE node
I20260811 07:36:03.598140 9038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:03.599534 9038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:03.602993 9038 hybrid_clock.cc:648] HybridClock initialized: now 1786433763602932 us; error 61 us; skew 500 ppm
Aug 11 07:36:03 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433763, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:03.609074 9038 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:36:03.610939 9038 webserver.cc:460] Webserver started at http://127.22.4.194:36185/ using document root <none> and password file <none>
I20260811 07:36:03.612011 9038 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:03.612157 9038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:03.612578 9038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:36:03 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433763, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:03.646903 9038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "795e8a44764f4d52bf01b82a0f5d9a0c"
format_stamp: "Formatted at 2026-08-11 07:36:03 on dist-test-slave-7z32"
server_key: "c4c2a603e900941e20d4f12f4169206c"
server_key_iv: "24a2447d878101f5b7112bcb1f933896"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:03.648064 9038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "795e8a44764f4d52bf01b82a0f5d9a0c"
format_stamp: "Formatted at 2026-08-11 07:36:03 on dist-test-slave-7z32"
server_key: "c4c2a603e900941e20d4f12f4169206c"
server_key_iv: "24a2447d878101f5b7112bcb1f933896"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:03.659584 9038 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.007s sys 0.000s
I20260811 07:36:03.723035 9071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:03.726073 9038 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260811 07:36:03.726540 9038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "795e8a44764f4d52bf01b82a0f5d9a0c"
format_stamp: "Formatted at 2026-08-11 07:36:03 on dist-test-slave-7z32"
server_key: "c4c2a603e900941e20d4f12f4169206c"
server_key_iv: "24a2447d878101f5b7112bcb1f933896"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:03.727082 9038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:03.778548 9038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:03.782956 9038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:03.783216 9038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:03.784155 9038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:03.785578 9038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:03.785657 9038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:03.785718 9038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:03.785753 9038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:03.812155 9038 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:35199
I20260811 07:36:03.812330 9255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:35199 every 8 connection(s)
I20260811 07:36:03.813776 9038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:36:03.821395 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 9038
I20260811 07:36:03.821784 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:36:03.822950 22547 external_mini_cluster.cc:1428] Setting key eee88c29c32abe340afedb056b430a46
Aug 11 07:36:03 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433763, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:36:03.868815 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:03.818486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:59287 (local address 127.22.4.254:32923)
0811 07:36:03.822692 (+ 4206us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:03.822698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:03.824053 (+ 1355us) server_negotiation.cc:407] Connection header received
0811 07:36:03.829114 (+ 5061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:03.829120 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:03.829215 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:03.829500 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:03.835313 (+ 5813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:03.836184 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:03.840904 (+ 4720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:03.841901 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:03.842135 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:03.848728 (+ 6593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:03.848734 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:03.848737 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:03.848792 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:03.851166 (+ 2374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:03.852599 (+ 1433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:03.852605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:03.852608 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:03.852746 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:03.853431 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:03.853435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:03.853437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:03.853779 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:03.853903 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:03.868332 (+ 14429us) server_negotiation.cc:299] Negotiation successful
0811 07:36:03.868600 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4027}
I20260811 07:36:03.870780 9260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:03.819366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:32923 (local address 127.22.4.194:59287)
0811 07:36:03.823690 (+ 4324us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:03.823836 (+ 146us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:03.825716 (+ 1880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:03.830310 (+ 4594us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:03.830341 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:03.831925 (+ 1584us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:03.834672 (+ 2747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:03.834736 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:03.836530 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:03.836536 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:03.840349 (+ 3813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:03.840408 (+ 59us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:03.842470 (+ 2062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:03.842480 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:03.843041 (+ 561us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:03.844308 (+ 1267us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:03.844347 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:03.848217 (+ 3870us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:03.851466 (+ 3249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:03.851484 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:03.851530 (+ 46us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:03.852352 (+ 822us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:03.852904 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:03.852908 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:03.852911 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:03.853255 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:03.866905 (+ 13650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:03.866925 (+ 20us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:03.867626 (+ 701us) client_negotiation.cc:769] Sending connection context
0811 07:36:03.868075 (+ 449us) client_negotiation.cc:240] Negotiation successful
0811 07:36:03.869183 (+ 1108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3778,"thread_start_us":409,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:36:03.873304 9256 heartbeater.cc:347] Connected to a master server at 127.22.4.254:32923
I20260811 07:36:03.873706 9256 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:03.874604 9256 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
I20260811 07:36:03.876618 8698 ts_manager.cc:194] Registered new tserver with Master: 795e8a44764f4d52bf01b82a0f5d9a0c (127.22.4.194:35199)
I20260811 07:36:03.877595 8698 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:59287
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:36:03.899840 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:38805/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:32923
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:04.138307 9265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:04.138795 9265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:04.138913 9265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:04.147419 9265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:04.147662 9265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:04.147846 9265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:36:04.157830 9265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.22.4.212:38805/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:04.159945 9265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:04.161888 9265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:04.180137 9273 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:04.179919 9274 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:04.182229 9265 server_base.cc:1034] running on GCE node
W20260811 07:36:04.187028 9278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:04.188002 9265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:04.189134 9265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
Aug 11 07:36:04 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433763, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:04.196587 9265 hybrid_clock.cc:648] HybridClock initialized: now 1786433764196474 us; error 104 us; skew 500 ppm
Aug 11 07:36:04 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433764, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:04.202390 9265 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:36:04.204540 9265 webserver.cc:460] Webserver started at http://127.22.4.195:34287/ using document root <none> and password file <none>
I20260811 07:36:04.205941 9265 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:04.206343 9265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:04.206863 9265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 07:36:04 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433764, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:04.229903 9265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "6e06b43334744480a09e0bb210e9f12e"
format_stamp: "Formatted at 2026-08-11 07:36:04 on dist-test-slave-7z32"
server_key: "0663c29f28fe7ab740b2cdc525812c05"
server_key_iv: "56ce5eea84e9d8892ca83ab2ce048f47"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:04.230996 9265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "6e06b43334744480a09e0bb210e9f12e"
format_stamp: "Formatted at 2026-08-11 07:36:04 on dist-test-slave-7z32"
server_key: "0663c29f28fe7ab740b2cdc525812c05"
server_key_iv: "56ce5eea84e9d8892ca83ab2ce048f47"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:04.237520 9265 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 07:36:04.261658 9293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:04.264919 9265 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.000s
I20260811 07:36:04.265148 9265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "6e06b43334744480a09e0bb210e9f12e"
format_stamp: "Formatted at 2026-08-11 07:36:04 on dist-test-slave-7z32"
server_key: "0663c29f28fe7ab740b2cdc525812c05"
server_key_iv: "56ce5eea84e9d8892ca83ab2ce048f47"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:04.265311 9265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:04.294960 9265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:04.301220 9265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:04.301584 9265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:04.302762 9265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:04.304390 9265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:04.304504 9265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:04.304613 9265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:04.304678 9265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:04.337042 9265 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:43373
I20260811 07:36:04.338383 9030 heartbeater.cc:503] Master 127.22.4.254:32923 was elected leader, sending a full tablet report...
I20260811 07:36:04.338608 9265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:36:04.342567 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 9265
I20260811 07:36:04.342746 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:36:04.343200 22547 external_mini_cluster.cc:1428] Setting key 2c49e8b502d4509d6a98e7ef0fab062f
I20260811 07:36:04.344280 9480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:43373 every 8 connection(s)
Aug 11 07:36:04 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433764, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:04.388123 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:04.367138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:59165 (local address 127.22.4.254:32923)
0811 07:36:04.367436 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:04.367442 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:04.367469 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:36:04.367544 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:04.367548 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:04.367619 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:04.367793 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:04.370807 (+ 3014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:04.371669 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:04.373936 (+ 2267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:04.374302 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:04.374437 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:04.381284 (+ 6847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:04.381288 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:04.381291 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:04.381325 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:04.385381 (+ 4056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:04.386138 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:04.386143 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:04.386145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:04.386254 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:04.386674 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:04.386678 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:04.386681 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:04.386998 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:04.387100 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:04.387771 (+ 671us) server_negotiation.cc:299] Negotiation successful
0811 07:36:04.387931 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 07:36:04.389271 9487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:04.355439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:32923 (local address 127.22.4.195:59165)
0811 07:36:04.359552 (+ 4113us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:04.359663 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:04.360997 (+ 1334us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:04.368187 (+ 7190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:04.368203 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:04.368690 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:04.370610 (+ 1920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:04.370643 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:04.371819 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:04.371823 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:04.373758 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:04.373777 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:04.377492 (+ 3715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:04.377502 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:04.377814 (+ 312us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:04.379018 (+ 1204us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:04.379045 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:04.380856 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:04.385556 (+ 4700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:04.385570 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:04.385601 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:04.385986 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:04.386353 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:04.386358 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:04.386360 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:04.386548 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:04.387120 (+ 572us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:04.387129 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:04.387470 (+ 341us) client_negotiation.cc:769] Sending connection context
0811 07:36:04.387722 (+ 252us) client_negotiation.cc:240] Negotiation successful
0811 07:36:04.388141 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3688,"thread_start_us":340,"threads_started":1}
I20260811 07:36:04.397482 9484 heartbeater.cc:347] Connected to a master server at 127.22.4.254:32923
I20260811 07:36:04.397943 9484 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:04.398937 9484 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
I20260811 07:36:04.400867 8697 ts_manager.cc:194] Registered new tserver with Master: 6e06b43334744480a09e0bb210e9f12e (127.22.4.195:43373)
I20260811 07:36:04.401814 8697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:59165
I20260811 07:36:04.409443 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:36:04.410893 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 8831
I20260811 07:36:04.487226 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 9038
I20260811 07:36:04.531948 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 9265
I20260811 07:36:04.575719 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 8647
I20260811 07:36:04.641552 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:32923
--webserver_interface=127.22.4.254
--webserver_port=43865
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:32923
--ranger_config_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:38805/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.4.212:38805/kms with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:04.789958 9488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:04.790336 9488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:04.790383 9488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:04.795228 9488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:04.795320 9488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:04.795343 9488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:04.795360 9488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:04.795377 9488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:04.801748 9488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.4.212:38805/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:32923
--ranger_config_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:32923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:04.803174 9488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:04.804625 9488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:04.816151 9495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:04.816228 9498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:04.816293 9494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:04.816249 9488 server_base.cc:1034] running on GCE node
I20260811 07:36:04.818104 9488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:04.820004 9488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:04.821312 9488 hybrid_clock.cc:648] HybridClock initialized: now 1786433764821245 us; error 92 us; skew 500 ppm
Aug 11 07:36:04 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433764, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:04.826625 9488 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:04.828369 9488 webserver.cc:460] Webserver started at http://127.22.4.254:43865/ using document root <none> and password file <none>
I20260811 07:36:04.829392 9488 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:04.829579 9488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:36:04 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433764, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:04.924239 9488 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.001s
I20260811 07:36:04.928452 9511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:04.930160 9488 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260811 07:36:04.930363 9488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "3911ca5ea2e3475ea2a00578ca03a930"
format_stamp: "Formatted at 2026-08-11 07:36:01 on dist-test-slave-7z32"
server_key: "105679ae7b732acaf05e0d3730f174fc"
server_key_iv: "f8bd87eebffc1bb9aa147f40c89e8e6b"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:04.931327 9488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:04.947315 9488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:04.950806 9488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:04.951130 9488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:04.960392 9488 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:32923
I20260811 07:36:04.960579 9599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:32923 every 8 connection(s)
I20260811 07:36:04.961834 9488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:04.967895 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 9488
I20260811 07:36:04.968469 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:38805/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:35109
--local_ip_for_outbound_sockets=127.22.4.193
--tserver_master_addrs=127.22.4.254:32923
--webserver_port=33235
--webserver_interface=127.22.4.193
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.4.212:38805/kms with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:36:04.970546 9601 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:36:04.974587 9601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Bootstrap starting.
I20260811 07:36:05.004549 9601 log.cc:824] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:05.014550 9601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:36:05.015480 9601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Bootstrap complete.
I20260811 07:36:05.023023 9601 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } }
I20260811 07:36:05.024322 9601 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3911ca5ea2e3475ea2a00578ca03a930, State: Initialized, Role: FOLLOWER
I20260811 07:36:05.025733 9601 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } }
I20260811 07:36:05.026016 9601 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:36:05.026165 9601 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:36:05.026330 9601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:36:05.030139 9601 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } }
I20260811 07:36:05.030721 9601 leader_election.cc:302] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3911ca5ea2e3475ea2a00578ca03a930; no voters:
I20260811 07:36:05.031245 9601 leader_election.cc:288] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:36:05.031589 9606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:36:05.031987 9606 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [term 2 LEADER]: Becoming Leader. State: Replica: 3911ca5ea2e3475ea2a00578ca03a930, State: Running, Role: LEADER
I20260811 07:36:05.032435 9606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } }
I20260811 07:36:05.033460 9601 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:05.034390 9609 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3911ca5ea2e3475ea2a00578ca03a930. Latest consensus state: current_term: 2 leader_uuid: "3911ca5ea2e3475ea2a00578ca03a930" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } } }
I20260811 07:36:05.034607 9609 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:05.035146 9607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3911ca5ea2e3475ea2a00578ca03a930" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3911ca5ea2e3475ea2a00578ca03a930" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 32923 } } }
I20260811 07:36:05.035297 9607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:05.036864 9616 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:05.037215 9601 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 07:36:05.045966 9616 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:05.047226 9616 catalog_manager.cc:1259] Loaded cluster ID: 67544ed490cd40bba247c77a37612468
I20260811 07:36:05.047341 9616 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:36:05.051381 9616 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:36:05.052377 9616 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Loaded TSK: 0
I20260811 07:36:05.053879 9616 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:36:05.119366 9603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:05.119737 9603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:05.119997 9603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:05.126123 9603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:05.126296 9603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:05.126425 9603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:36:05.133179 9603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.4.212:38805/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:35109
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=33235
--tserver_master_addrs=127.22.4.254:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:05.134979 9603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:05.136569 9603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:05.150135 9650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:05.150522 9649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:05.150135 9652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:05.150992 9603 server_base.cc:1034] running on GCE node
I20260811 07:36:05.152451 9603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:05.153453 9603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:05.156749 9603 hybrid_clock.cc:648] HybridClock initialized: now 1786433765156686 us; error 80 us; skew 500 ppm
Aug 11 07:36:05 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:05.161401 9603 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:36:05.163127 9603 webserver.cc:460] Webserver started at http://127.22.4.193:33235/ using document root <none> and password file <none>
I20260811 07:36:05.164399 9603 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:05.164543 9603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:36:05 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:05.192569 9603 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:36:05.196996 9673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.199002 9603 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:36:05.199165 9603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "5c887459f34244cf857bf4a54ed94794"
format_stamp: "Formatted at 2026-08-11 07:36:03 on dist-test-slave-7z32"
server_key: "b002000415c6a0bfebf74a82f5d89668"
server_key_iv: "f04175afcff24b7f2e555f445f81c33b"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:05.200039 9603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:05.240178 9603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:05.243917 9603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:05.244160 9603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:05.244872 9603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:05.245987 9603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:05.246062 9603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.246187 9603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:05.246250 9603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.261647 9603 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:35109
I20260811 07:36:05.264936 9851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:35109 every 8 connection(s)
I20260811 07:36:05.265344 9603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:36:05.267223 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 9603
I20260811 07:36:05.267774 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:38805/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:35199
--local_ip_for_outbound_sockets=127.22.4.194
--tserver_master_addrs=127.22.4.254:32923
--webserver_port=36185
--webserver_interface=127.22.4.194
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.4.212:38805/kms with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:36:05 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:05.296145 9861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:05.270303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:32923 (local address 127.22.4.193:35359)
0811 07:36:05.272296 (+ 1993us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:05.272377 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:05.273455 (+ 1078us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:05.276159 (+ 2704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:05.276170 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:05.276616 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:05.277366 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:05.277394 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.279868 (+ 2474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:05.279876 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:05.281620 (+ 1744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:05.281643 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.283603 (+ 1960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:05.283612 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:05.283903 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:05.284754 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:05.284780 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:05.287094 (+ 2314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:05.290629 (+ 3535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:05.290639 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:05.290663 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:05.291188 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:05.291782 (+ 594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:05.291786 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:05.291788 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:05.292160 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:05.293143 (+ 983us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:05.293151 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:05.293498 (+ 347us) client_negotiation.cc:769] Sending connection context
0811 07:36:05.293839 (+ 341us) client_negotiation.cc:240] Negotiation successful
0811 07:36:05.294454 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1786,"thread_start_us":161,"threads_started":1}
I20260811 07:36:05.298772 9862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:05.270415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:35359 (local address 127.22.4.254:32923)
0811 07:36:05.271977 (+ 1562us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:05.272010 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:05.272532 (+ 522us) server_negotiation.cc:407] Connection header received
0811 07:36:05.274046 (+ 1514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:05.274065 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:05.275217 (+ 1152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:05.275969 (+ 752us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:05.277709 (+ 1740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.279624 (+ 1915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:05.281851 (+ 2227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.282797 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:05.283099 (+ 302us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:05.287494 (+ 4395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:05.287508 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:05.287535 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:05.287590 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:05.290390 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:05.291418 (+ 1028us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:05.291430 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:05.291439 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:05.291639 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:05.292305 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:05.292308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:05.292310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:05.292925 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:05.293063 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:05.296937 (+ 3874us) server_negotiation.cc:299] Negotiation successful
0811 07:36:05.297398 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1296,"thread_start_us":231,"threads_started":1}
I20260811 07:36:05.305323 9854 heartbeater.cc:347] Connected to a master server at 127.22.4.254:32923
I20260811 07:36:05.305794 9854 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:05.306756 9854 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
W20260811 07:36:05.311618 9854 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:32923 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:36:05.311894 9854 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:05.312232 9854 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
I20260811 07:36:05.319161 9854 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:05.319605 9854 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
W20260811 07:36:05.321111 9854 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:36:05.471091 9860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:05.471576 9860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:05.471673 9860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:05.477420 9860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:05.477562 9860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:05.477667 9860 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:36:05.487262 9860 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.4.212:38805/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:35199
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=36185
--tserver_master_addrs=127.22.4.254:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9860
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:05.490598 9860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:05.492683 9860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:05.513015 9871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:05.513082 9860 server_base.cc:1034] running on GCE node
W20260811 07:36:05.513124 9872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:05.513911 9876 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:05.514572 9860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:05.515576 9860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:05.516847 9860 hybrid_clock.cc:648] HybridClock initialized: now 1786433765516815 us; error 54 us; skew 500 ppm
Aug 11 07:36:05 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:05.520836 9860 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:36:05.524184 9860 webserver.cc:460] Webserver started at http://127.22.4.194:36185/ using document root <none> and password file <none>
I20260811 07:36:05.525005 9860 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:05.525169 9860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:36:05 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:05.557843 9860 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:36:05.561122 9888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.563058 9860 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:36:05.563284 9860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "795e8a44764f4d52bf01b82a0f5d9a0c"
format_stamp: "Formatted at 2026-08-11 07:36:03 on dist-test-slave-7z32"
server_key: "c4c2a603e900941e20d4f12f4169206c"
server_key_iv: "24a2447d878101f5b7112bcb1f933896"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:05.564839 9860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:05.600427 9860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:05.605998 9860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:05.606297 9860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:05.607224 9860 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:05.608451 9860 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:05.608512 9860 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.608592 9860 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:05.608642 9860 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.622051 9860 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:35199
I20260811 07:36:05.622119 10078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:35199 every 8 connection(s)
I20260811 07:36:05.624527 9860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:36:05.628342 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 9860
I20260811 07:36:05.629072 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.22.4.212:38805/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:43373
--local_ip_for_outbound_sockets=127.22.4.195
--tserver_master_addrs=127.22.4.254:32923
--webserver_port=34287
--webserver_interface=127.22.4.195
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:37573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.22.4.212:38805/kms with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:36:05 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:05.648633 9862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:05.628301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:37123 (local address 127.22.4.254:32923)
0811 07:36:05.628469 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:05.628475 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:05.630921 (+ 2446us) server_negotiation.cc:407] Connection header received
0811 07:36:05.632153 (+ 1232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:05.632159 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:05.632240 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:05.632304 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:05.634996 (+ 2692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.636119 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:05.638326 (+ 2207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.638721 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:05.638864 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:05.642743 (+ 3879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:05.642749 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:05.642751 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:05.642787 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:05.644900 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:05.645725 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:05.645731 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:05.645733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:05.645845 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:05.646568 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:05.646573 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:05.646575 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:05.646910 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:05.647022 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:05.648203 (+ 1181us) server_negotiation.cc:299] Negotiation successful
0811 07:36:05.648407 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 07:36:05.650928 10084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:05.628950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:32923 (local address 127.22.4.194:37123)
0811 07:36:05.630664 (+ 1714us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:05.630736 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:05.631783 (+ 1047us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:05.632845 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:05.632858 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:05.633444 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:05.634604 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:05.634626 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.636403 (+ 1777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:05.636408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:05.638082 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:05.638100 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.639162 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:05.639167 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:05.639432 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:05.640535 (+ 1103us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:05.640561 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:05.642450 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:05.645084 (+ 2634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:05.645093 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:05.645118 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:05.645577 (+ 459us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:05.645980 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:05.645984 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:05.645986 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:05.646210 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:05.647110 (+ 900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:05.647119 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:05.647776 (+ 657us) client_negotiation.cc:769] Sending connection context
0811 07:36:05.649426 (+ 1650us) client_negotiation.cc:240] Negotiation successful
0811 07:36:05.649898 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1435,"thread_start_us":213,"threads_started":1}
I20260811 07:36:05.653254 10080 heartbeater.cc:347] Connected to a master server at 127.22.4.254:32923
I20260811 07:36:05.653698 10080 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:05.654618 10080 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
W20260811 07:36:05.657716 10080 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:32923 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:36:05.657972 10080 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:05.658347 10080 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
I20260811 07:36:05.659786 10080 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:05.660117 10080 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
W20260811 07:36:05.661288 10080 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:36:05.853044 10086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:05.853507 10086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:05.853578 10086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:05.858582 10086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:05.858696 10086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:05.858897 10086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:36:05.865149 10086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:37573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.22.4.212:38805/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:43373
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=34287
--tserver_master_addrs=127.22.4.254:32923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:05.866786 10086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:05.868340 10086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:05.882704 10102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:05.882993 10098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:05.882718 10099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:05.884510 10086 server_base.cc:1034] running on GCE node
I20260811 07:36:05.885370 10086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:05.886639 10086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:05.890125 10086 hybrid_clock.cc:648] HybridClock initialized: now 1786433765890055 us; error 86 us; skew 500 ppm
Aug 11 07:36:05 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:05.895529 10086 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:36:05.896951 10086 webserver.cc:460] Webserver started at http://127.22.4.195:34287/ using document root <none> and password file <none>
I20260811 07:36:05.897707 10086 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:05.897814 10086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 07:36:05 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:05.929418 10086 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:36:05.939808 10114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.941576 10086 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.001s sys 0.001s
I20260811 07:36:05.941768 10086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "6e06b43334744480a09e0bb210e9f12e"
format_stamp: "Formatted at 2026-08-11 07:36:04 on dist-test-slave-7z32"
server_key: "0663c29f28fe7ab740b2cdc525812c05"
server_key_iv: "56ce5eea84e9d8892ca83ab2ce048f47"
server_key_version: "kuduclusterkey@0"
I20260811 07:36:05.942473 10086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:05.964875 10086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:05.969321 10086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:05.969586 10086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:05.970449 10086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:05.971662 10086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:05.971725 10086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.971781 10086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:05.971802 10086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:05.989310 10086 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:43373
I20260811 07:36:05.989512 10279 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:43373 every 8 connection(s)
I20260811 07:36:05.990669 10086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:36:05.996085 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 10086
Aug 11 07:36:06 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433765, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:06.008478 10285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:05.997060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33598 (local address 127.22.4.254:32923)
0811 07:36:05.997720 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:05.997724 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:05.997737 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:36:05.997783 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:05.997786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:05.997878 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:05.998001 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:05.998981 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.999911 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:06.000863 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:06.001177 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:06.001288 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:06.003329 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:06.003334 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:06.003337 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:06.003373 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:06.005743 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:06.006402 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:06.006405 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:06.006406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:06.006551 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:06.006921 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:06.006925 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:06.006926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:06.007196 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:06.007427 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:06.008181 (+ 754us) server_negotiation.cc:299] Negotiation successful
0811 07:36:06.008324 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":588,"thread_start_us":103,"threads_started":1}
I20260811 07:36:06.014988 9862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:05.995173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:40651 (local address 127.22.4.254:32923)
0811 07:36:05.995468 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:05.995477 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:05.995513 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:36:05.996063 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:05.996069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:05.996163 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:05.996325 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:05.999175 (+ 2850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:05.999911 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:06.003571 (+ 3660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:06.003934 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:06.004031 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:06.008760 (+ 4729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:06.008764 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:06.008767 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:06.008793 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:06.010543 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:06.012183 (+ 1640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:06.012187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:06.012188 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:06.012273 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:06.013077 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:06.013084 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:06.013087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:06.013362 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:06.013467 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:06.014585 (+ 1118us) server_negotiation.cc:299] Negotiation successful
0811 07:36:06.014725 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":107}
I20260811 07:36:06.016630 10283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:05.993887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:32923 (local address 127.22.4.195:40651)
0811 07:36:05.994528 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:05.994589 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:05.995713 (+ 1124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:05.997173 (+ 1460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:05.997191 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:05.997804 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:05.998939 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:05.998973 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:06.000977 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:06.000982 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:06.003400 (+ 2418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:06.003419 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:06.004348 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:06.004356 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:06.004646 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:06.005329 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:06.005357 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:06.007919 (+ 2562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:06.010884 (+ 2965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:06.010897 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:06.010931 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:06.012028 (+ 1097us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:06.012398 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:06.012403 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:06.012405 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:06.012848 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:06.013522 (+ 674us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:06.013532 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:06.014139 (+ 607us) client_negotiation.cc:769] Sending connection context
0811 07:36:06.014482 (+ 343us) client_negotiation.cc:240] Negotiation successful
0811 07:36:06.015076 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":204,"threads_started":1}
I20260811 07:36:06.018658 10280 heartbeater.cc:347] Connected to a master server at 127.22.4.254:32923
I20260811 07:36:06.019170 10280 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:06.019924 10280 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
W20260811 07:36:06.024708 10280 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:32923 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 07:36:06.024914 10280 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:06.025168 10280 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
I20260811 07:36:06.026222 10280 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:06.026472 10280 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
W20260811 07:36:06.027422 10280 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:36:06.321540 9854 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:06.321988 9854 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
I20260811 07:36:06.324229 9538 ts_manager.cc:194] Registered new tserver with Master: 5c887459f34244cf857bf4a54ed94794 (127.22.4.193:35109)
I20260811 07:36:06.327010 9538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:35359
Aug 11 07:36:06 dist-test-slave-7z32 krb5kdc[7948](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786433766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:06.661660 10080 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:06.662173 10080 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
I20260811 07:36:06.663393 9538 ts_manager.cc:194] Registered new tserver with Master: 795e8a44764f4d52bf01b82a0f5d9a0c (127.22.4.194:35199)
I20260811 07:36:06.664306 9538 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:37123
I20260811 07:36:07.028157 10280 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:07.028710 10280 heartbeater.cc:511] Master 127.22.4.254:32923 requested a full tablet report, sending...
I20260811 07:36:07.030119 9540 ts_manager.cc:194] Registered new tserver with Master: 6e06b43334744480a09e0bb210e9f12e (127.22.4.195:43373)
I20260811 07:36:07.031172 9540 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:40651
I20260811 07:36:07.043983 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:36:07.075663 10319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.047251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33610 (local address 127.22.4.254:32923)
0811 07:36:07.048094 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:07.048101 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:07.048614 (+ 513us) server_negotiation.cc:407] Connection header received
0811 07:36:07.048818 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:07.048823 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:07.048918 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:07.049095 (+ 177us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:07.050563 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.052218 (+ 1655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.054138 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.054589 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.054719 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.068156 (+ 13437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:07.068164 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:07.068168 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:07.068231 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:07.071708 (+ 3477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:07.072637 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:07.072642 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:07.072645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:07.072785 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:07.073212 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:07.073216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:07.073218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:07.073551 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:07.073722 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:07.075057 (+ 1335us) server_negotiation.cc:299] Negotiation successful
0811 07:36:07.075337 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":728,"thread_start_us":165,"threads_started":1}
I20260811 07:36:07.082584 9540 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33610:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:36:07.088668 9540 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:36:07.126325 10332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.110369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58830 (local address 127.22.4.194:35199)
0811 07:36:07.111528 (+ 1159us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:07.111539 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:07.113478 (+ 1939us) server_negotiation.cc:407] Connection header received
0811 07:36:07.113680 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:07.113688 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:07.113993 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:07.114175 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:07.115810 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.117178 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.122010 (+ 4832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.123345 (+ 1335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.123508 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.123757 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:07.124413 (+ 656us) server_negotiation.cc:299] Negotiation successful
0811 07:36:07.126090 (+ 1677us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":971,"thread_start_us":214,"threads_started":1}
I20260811 07:36:07.128005 10328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.109707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:35199 (local address 127.0.0.1:58830)
0811 07:36:07.113342 (+ 3635us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:07.113355 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:07.113490 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:07.114413 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:07.114424 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:07.114456 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:07.114648 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.114662 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.117380 (+ 2718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.117384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.121688 (+ 4304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.121719 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.123870 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.123876 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.124063 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.124142 (+ 79us) client_negotiation.cc:769] Sending connection context
0811 07:36:07.127312 (+ 3170us) client_negotiation.cc:240] Negotiation successful
0811 07:36:07.127788 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3572,"mutex_wait_us":1486,"thread_start_us":176,"threads_started":1}
I20260811 07:36:07.129416 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.110952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50256 (local address 127.22.4.195:43373)
0811 07:36:07.113209 (+ 2257us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:07.113216 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:07.113895 (+ 679us) server_negotiation.cc:407] Connection header received
0811 07:36:07.114168 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:07.114174 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:07.114364 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:07.114493 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:07.115739 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.117178 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.125410 (+ 8232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.126597 (+ 1187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.126729 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.127013 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:07.127762 (+ 749us) server_negotiation.cc:299] Negotiation successful
0811 07:36:07.129032 (+ 1270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2132,"thread_start_us":91,"threads_started":1}
I20260811 07:36:07.130712 10330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.110222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:43373 (local address 127.0.0.1:50256)
0811 07:36:07.113779 (+ 3557us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:07.113793 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:07.113973 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:07.114716 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:07.114723 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:07.114746 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:07.114883 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.114890 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.117380 (+ 2490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.117384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.125098 (+ 7714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.125132 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.127333 (+ 2201us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.127339 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.127470 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.127506 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:36:07.127607 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:36:07.130387 (+ 2780us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3493,"mutex_wait_us":2263,"thread_start_us":113,"threads_started":1}
I20260811 07:36:07.134810 9962 tablet_service.cc:1467] Processing CreateTablet for tablet c433641a72b14ff7ae41ffaccbca0c39 (DEFAULT_TABLE table=test-table [id=a0f8a52b23aa4acfacd21d586f80b9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:07.137282 9962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c433641a72b14ff7ae41ffaccbca0c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:07.138100 10187 tablet_service.cc:1467] Processing CreateTablet for tablet c433641a72b14ff7ae41ffaccbca0c39 (DEFAULT_TABLE table=test-table [id=a0f8a52b23aa4acfacd21d586f80b9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:07.140857 10187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c433641a72b14ff7ae41ffaccbca0c39. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:36:07 dist-test-slave-7z32 krb5kdc[7948](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433766, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for HTTP/127.22.4.212@KRBTEST.COM
I20260811 07:36:07.166671 10336 tablet_bootstrap.cc:492] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: Bootstrap starting.
I20260811 07:36:07.169536 10331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.109016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35109 (local address 127.0.0.1:56874)
0811 07:36:07.112641 (+ 3625us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:07.112726 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:07.112887 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:07.151945 (+ 39058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:07.151950 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:07.152125 (+ 175us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:07.152409 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.152425 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.166171 (+ 13746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.166178 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.167395 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.167417 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.169022 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.169026 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.169131 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.169162 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:36:07.169247 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 07:36:07.169348 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3343,"thread_start_us":194,"threads_started":1}
I20260811 07:36:07.170308 10333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.110764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56874 (local address 127.22.4.193:35109)
0811 07:36:07.151161 (+ 40397us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:07.151171 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:07.151220 (+ 49us) server_negotiation.cc:407] Connection header received
0811 07:36:07.151352 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:07.151360 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:07.151669 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:07.152731 (+ 1062us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:07.152968 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.160064 (+ 7096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.167657 (+ 7593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.168615 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.168749 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.168920 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:07.169968 (+ 1048us) server_negotiation.cc:299] Negotiation successful
0811 07:36:07.170124 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40177,"thread_start_us":206,"threads_started":1}
I20260811 07:36:07.170297 10336 tablet_bootstrap.cc:654] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:07.171696 10336 log.cc:824] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:07.174388 9730 tablet_service.cc:1467] Processing CreateTablet for tablet c433641a72b14ff7ae41ffaccbca0c39 (DEFAULT_TABLE table=test-table [id=a0f8a52b23aa4acfacd21d586f80b9ff]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:07.176522 9730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c433641a72b14ff7ae41ffaccbca0c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:07.177024 10336 tablet_bootstrap.cc:492] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: No bootstrap required, opened a new log
I20260811 07:36:07.177276 10336 ts_tablet_manager.cc:1397] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260811 07:36:07.181766 10336 raft_consensus.cc:348] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
I20260811 07:36:07.182117 10336 raft_consensus.cc:374] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:07.182185 10336 raft_consensus.cc:729] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 795e8a44764f4d52bf01b82a0f5d9a0c, State: Initialized, Role: FOLLOWER
I20260811 07:36:07.182796 10336 consensus_queue.cc:260] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
I20260811 07:36:07.184557 10336 ts_tablet_manager.cc:1428] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:36:07.185271 10080 heartbeater.cc:503] Master 127.22.4.254:32923 was elected leader, sending a full tablet report...
I20260811 07:36:07.185637 10338 tablet_bootstrap.cc:492] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Bootstrap starting.
I20260811 07:36:07.189074 10338 tablet_bootstrap.cc:654] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:07.191076 10338 log.cc:824] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:07.191841 10340 tablet_bootstrap.cc:492] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794: Bootstrap starting.
I20260811 07:36:07.195550 10340 tablet_bootstrap.cc:654] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:07.196998 10340 log.cc:824] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:07.202350 10340 tablet_bootstrap.cc:492] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794: No bootstrap required, opened a new log
I20260811 07:36:07.202703 10340 ts_tablet_manager.cc:1397] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260811 07:36:07.208714 10338 tablet_bootstrap.cc:492] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: No bootstrap required, opened a new log
I20260811 07:36:07.209355 10338 ts_tablet_manager.cc:1397] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Time spent bootstrapping tablet: real 0.024s user 0.005s sys 0.003s
I20260811 07:36:07.209458 10340 raft_consensus.cc:348] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
I20260811 07:36:07.209856 10340 raft_consensus.cc:374] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:07.209937 10340 raft_consensus.cc:729] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c887459f34244cf857bf4a54ed94794, State: Initialized, Role: FOLLOWER
I20260811 07:36:07.210760 10340 consensus_queue.cc:260] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
I20260811 07:36:07.212667 10340 ts_tablet_manager.cc:1428] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794: Time spent starting tablet: real 0.010s user 0.011s sys 0.000s
I20260811 07:36:07.213428 9854 heartbeater.cc:503] Master 127.22.4.254:32923 was elected leader, sending a full tablet report...
I20260811 07:36:07.215394 10338 raft_consensus.cc:348] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
I20260811 07:36:07.215831 10338 raft_consensus.cc:374] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:07.215916 10338 raft_consensus.cc:729] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e06b43334744480a09e0bb210e9f12e, State: Initialized, Role: FOLLOWER
I20260811 07:36:07.216694 10338 consensus_queue.cc:260] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
I20260811 07:36:07.218209 10338 ts_tablet_manager.cc:1428] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Time spent starting tablet: real 0.009s user 0.009s sys 0.001s
I20260811 07:36:07.218863 10280 heartbeater.cc:503] Master 127.22.4.254:32923 was elected leader, sending a full tablet report...
I20260811 07:36:07.232625 10339 raft_consensus.cc:482] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:07.233003 10339 raft_consensus.cc:504] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
I20260811 07:36:07.239519 10339 leader_election.cc:288] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c887459f34244cf857bf4a54ed94794 (127.22.4.193:35109), 6e06b43334744480a09e0bb210e9f12e (127.22.4.195:43373)
W20260811 07:36:07.243480 10282 tablet.cc:2369] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:07.248764 10333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.239457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:44589 (local address 127.22.4.193:35109)
0811 07:36:07.239851 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:07.239860 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:07.240374 (+ 514us) server_negotiation.cc:407] Connection header received
0811 07:36:07.240680 (+ 306us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:07.240687 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:07.240912 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:07.241004 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:07.242165 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.243586 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.246696 (+ 3110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.247622 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.247769 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.247858 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:07.248422 (+ 564us) server_negotiation.cc:299] Negotiation successful
0811 07:36:07.248546 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 07:36:07.249545 10349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.237598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35109 (local address 127.22.4.194:44589)
0811 07:36:07.240249 (+ 2651us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:07.240270 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:07.240505 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:07.241375 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:07.241379 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:07.241408 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:07.241627 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.241639 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.244109 (+ 2470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.244175 (+ 66us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.246030 (+ 1855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.246042 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.248089 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.248095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.248230 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.248262 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:36:07.249211 (+ 949us) client_negotiation.cc:240] Negotiation successful
0811 07:36:07.249322 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1948,"thread_start_us":795,"threads_started":1}
I20260811 07:36:07.251004 10350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.240204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:43373 (local address 127.22.4.194:49453)
0811 07:36:07.244710 (+ 4506us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:07.244872 (+ 162us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:07.245211 (+ 339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:07.245791 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:07.245794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:07.245823 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:07.245987 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.245995 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.248067 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.248071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.249340 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:07.249353 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.250459 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.250466 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:07.250585 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.250607 (+ 22us) client_negotiation.cc:769] Sending connection context
0811 07:36:07.250720 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 07:36:07.250818 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1428,"thread_start_us":181,"threads_started":1}
I20260811 07:36:07.251019 10335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.241385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:49453 (local address 127.22.4.195:43373)
0811 07:36:07.241573 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:07.241580 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:07.245008 (+ 3428us) server_negotiation.cc:407] Connection header received
0811 07:36:07.245381 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:07.245386 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:07.245483 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:07.245545 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:07.246509 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.247598 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.249525 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.250180 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.250353 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.250434 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:07.250743 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 07:36:07.250891 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:36:07.250990 9780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c433641a72b14ff7ae41ffaccbca0c39" candidate_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c887459f34244cf857bf4a54ed94794" is_pre_election: true
I20260811 07:36:07.251468 9780 raft_consensus.cc:2454] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 795e8a44764f4d52bf01b82a0f5d9a0c in term 0.
I20260811 07:36:07.252305 9895 leader_election.cc:302] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c887459f34244cf857bf4a54ed94794, 795e8a44764f4d52bf01b82a0f5d9a0c; no voters:
I20260811 07:36:07.252295 10218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c433641a72b14ff7ae41ffaccbca0c39" candidate_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e06b43334744480a09e0bb210e9f12e" is_pre_election: true
I20260811 07:36:07.252789 10339 raft_consensus.cc:2781] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:36:07.252915 10339 raft_consensus.cc:482] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:36:07.252977 10339 raft_consensus.cc:3037] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:07.252928 10218 raft_consensus.cc:2454] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 795e8a44764f4d52bf01b82a0f5d9a0c in term 0.
I20260811 07:36:07.254700 10339 raft_consensus.cc:504] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
I20260811 07:36:07.255324 10339 leader_election.cc:288] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [CANDIDATE]: Term 1 election: Requested vote from peers 5c887459f34244cf857bf4a54ed94794 (127.22.4.193:35109), 6e06b43334744480a09e0bb210e9f12e (127.22.4.195:43373)
I20260811 07:36:07.256124 9780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c433641a72b14ff7ae41ffaccbca0c39" candidate_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c887459f34244cf857bf4a54ed94794"
I20260811 07:36:07.256124 10218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c433641a72b14ff7ae41ffaccbca0c39" candidate_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e06b43334744480a09e0bb210e9f12e"
I20260811 07:36:07.256305 9780 raft_consensus.cc:3037] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:07.256305 10218 raft_consensus.cc:3037] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:07.258319 9780 raft_consensus.cc:2454] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795e8a44764f4d52bf01b82a0f5d9a0c in term 1.
I20260811 07:36:07.258319 10218 raft_consensus.cc:2454] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 795e8a44764f4d52bf01b82a0f5d9a0c in term 1.
I20260811 07:36:07.258872 9895 leader_election.cc:302] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c887459f34244cf857bf4a54ed94794, 795e8a44764f4d52bf01b82a0f5d9a0c; no voters:
I20260811 07:36:07.259101 10339 raft_consensus.cc:2781] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:07.259411 10339 raft_consensus.cc:686] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 1 LEADER]: Becoming Leader. State: Replica: 795e8a44764f4d52bf01b82a0f5d9a0c, State: Running, Role: LEADER
I20260811 07:36:07.259899 10339 consensus_queue.cc:237] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } }
W20260811 07:36:07.270290 9858 tablet.cc:2369] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:07.269649 9540 catalog_manager.cc:5495] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c reported cstate change: term changed from 0 to 1, leader changed from <none> to 795e8a44764f4d52bf01b82a0f5d9a0c (127.22.4.194). New cstate: current_term: 1 leader_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "795e8a44764f4d52bf01b82a0f5d9a0c" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35199 } health_report { overall_health: HEALTHY } } }
I20260811 07:36:07.329653 10332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.322978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58844 (local address 127.22.4.194:35199)
0811 07:36:07.323225 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:07.323231 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:07.323257 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:36:07.323422 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:07.323426 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:07.323526 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:07.323688 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:36:07.324203 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.325002 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.326348 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:07.326717 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:07.326929 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:07.328037 (+ 1108us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:36:07.328777 (+ 740us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:36:07.328977 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:07.329338 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 07:36:07.329437 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 07:36:07.341459 9780 raft_consensus.cc:1261] T c433641a72b14ff7ae41ffaccbca0c39 P 5c887459f34244cf857bf4a54ed94794 [term 1 FOLLOWER]: Refusing update from remote peer 795e8a44764f4d52bf01b82a0f5d9a0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:07.341459 10218 raft_consensus.cc:1261] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 1 FOLLOWER]: Refusing update from remote peer 795e8a44764f4d52bf01b82a0f5d9a0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:07.343048 10351 consensus_queue.cc:1035] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e06b43334744480a09e0bb210e9f12e" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:07.343400 10339 consensus_queue.cc:1035] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c887459f34244cf857bf4a54ed94794" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:07.366590 10363 mvcc.cc:205] Tried to move back new op lower bound from 7317232711015038976 to 7317232710700556288. Current Snapshot: MvccSnapshot[applied={T|T < 7317232711015038976}]
I20260811 07:36:07.369519 10360 mvcc.cc:205] Tried to move back new op lower bound from 7317232711015038976 to 7317232710700556288. Current Snapshot: MvccSnapshot[applied={T|T < 7317232711015038976 or (T in {7317232711015038976})}]
I20260811 07:36:07.397377 9540 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:36:07.397701 9540 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33610:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:36:07.402462 9540 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3911ca5ea2e3475ea2a00578ca03a930: Sending DeleteTablet for 3 replicas of tablet c433641a72b14ff7ae41ffaccbca0c39
I20260811 07:36:07.403754 9730 tablet_service.cc:1514] Processing DeleteTablet for tablet c433641a72b14ff7ae41ffaccbca0c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:07 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:56874
I20260811 07:36:07.404129 10187 tablet_service.cc:1514] Processing DeleteTablet for tablet c433641a72b14ff7ae41ffaccbca0c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:07 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:50256
I20260811 07:36:07.404544 9962 tablet_service.cc:1514] Processing DeleteTablet for tablet c433641a72b14ff7ae41ffaccbca0c39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:07 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:58830
I20260811 07:36:07.406651 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 9603
I20260811 07:36:07.424398 10378 tablet_replica.cc:330] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: stopping tablet replica
I20260811 07:36:07.424947 10378 raft_consensus.cc:2229] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:36:07.425580 10378 raft_consensus.cc:2258] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:07.428596 10377 tablet_replica.cc:330] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: stopping tablet replica
I20260811 07:36:07.429356 10377 raft_consensus.cc:2229] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:36:07.430030 10377 raft_consensus.cc:2258] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:07.437222 10378 ts_tablet_manager.cc:1905] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:07.439316 10377 ts_tablet_manager.cc:1905] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:07.441113 10378 ts_tablet_manager.cc:1918] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:07.441273 10378 log.cc:1196] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/c433641a72b14ff7ae41ffaccbca0c39
I20260811 07:36:07.441694 10378 ts_tablet_manager.cc:1939] T c433641a72b14ff7ae41ffaccbca0c39 P 795e8a44764f4d52bf01b82a0f5d9a0c: Deleting consensus metadata
I20260811 07:36:07.444067 10377 ts_tablet_manager.cc:1918] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:07.447392 10377 log.cc:1196] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/c433641a72b14ff7ae41ffaccbca0c39
I20260811 07:36:07.452126 9513 catalog_manager.cc:4841] TS 795e8a44764f4d52bf01b82a0f5d9a0c (127.22.4.194:35199): tablet c433641a72b14ff7ae41ffaccbca0c39 (table test-table [id=a0f8a52b23aa4acfacd21d586f80b9ff]) successfully deleted
I20260811 07:36:07.453154 10377 ts_tablet_manager.cc:1939] T c433641a72b14ff7ae41ffaccbca0c39 P 6e06b43334744480a09e0bb210e9f12e: Deleting consensus metadata
I20260811 07:36:07.456189 9514 catalog_manager.cc:4841] TS 6e06b43334744480a09e0bb210e9f12e (127.22.4.195:43373): tablet c433641a72b14ff7ae41ffaccbca0c39 (table test-table [id=a0f8a52b23aa4acfacd21d586f80b9ff]) successfully deleted
W20260811 07:36:07.456897 9514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:35109 (error 108)
I20260811 07:36:07.458777 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 9860
I20260811 07:36:07.487010 10331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:07.483613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35109 (local address 127.0.0.1:56876)
0811 07:36:07.486675 (+ 3062us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:07.486876 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:35109: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2877}
W20260811 07:36:07.487334 9514 catalog_manager.cc:4584] TS 5c887459f34244cf857bf4a54ed94794 (127.22.4.193:35109): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c433641a72b14ff7ae41ffaccbca0c39: Network error: Client connection negotiation failed: client connection to 127.22.4.193:35109: connect: Connection refused (error 111)
I20260811 07:36:07.499042 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 10086
I20260811 07:36:07.527338 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 9488
I20260811 07:36:07.578003 22547 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 07:36:07.936172 22547 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 07:36:07.936424 22547 mini_ranger.cc:66] Stopping Ranger...
I20260811 07:36:08.306061 22547 mini_ranger.cc:68] Stopped Ranger
2026-08-11 07:36:08.306 UTC [7991] LOG: received smart shutdown request
2026-08-11 07:36:08.313 UTC [7991] LOG: background worker "logical replication launcher" (PID 8005) exited with exit code 1
2026-08-11 07:36:08.314 UTC [7998] LOG: shutting down
2026-08-11 07:36:08.587 UTC [7991] LOG: database system is shut down
2026-08-11T07:36:08Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (79711 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:36:08 dist-test-slave-7z32 krb5kdc[10392](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:36:08 dist-test-slave-7z32 krb5kdc[10392](info): set up 2 sockets
Aug 11 07:36:08 dist-test-slave-7z32 krb5kdc[10392](info): commencing operation
krb5kdc: starting...
W20260811 07:36:10.166491 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.381s user 0.008s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:36:10 dist-test-slave-7z32 krb5kdc[10392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:36:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:36:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:36:10.340288 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34855
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:33567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34855,127.22.4.253:41513,127.22.4.252:38193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:10.500798 10409 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:10.501202 10409 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:10.501256 10409 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:10.505851 10409 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:10.505973 10409 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:10.505996 10409 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:10.506019 10409 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:10.506037 10409 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:10.512986 10409 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:33567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34855,127.22.4.253:41513,127.22.4.252:38193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10409
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:10.514676 10409 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:10.516136 10409 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:10.527890 10418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:10.528028 10424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:10.527915 10420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:10.528195 10409 server_base.cc:1034] running on GCE node
I20260811 07:36:10.529232 10409 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:10.531662 10409 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:10.533106 10409 hybrid_clock.cc:648] HybridClock initialized: now 1786433770533002 us; error 71 us; skew 500 ppm
Aug 11 07:36:10 dist-test-slave-7z32 krb5kdc[10392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:10.538012 10409 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:10.539958 10409 webserver.cc:460] Webserver started at http://127.22.4.254:33957/ using document root <none> and password file <none>
I20260811 07:36:10.540885 10409 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:10.541007 10409 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:10.541332 10409 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:10.544463 10409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "e0e704fea90844e5b9139c95795d6fd9"
format_stamp: "Formatted at 2026-08-11 07:36:10 on dist-test-slave-7z32"
server_key: "5ea65e085a86597e79910a8b7990643f"
server_key_iv: "f82b7eb690c8df0f06f3c7ccd7a99f54"
server_key_version: "encryptionkey@0"
I20260811 07:36:10.545313 10409 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "e0e704fea90844e5b9139c95795d6fd9"
format_stamp: "Formatted at 2026-08-11 07:36:10 on dist-test-slave-7z32"
server_key: "5ea65e085a86597e79910a8b7990643f"
server_key_iv: "f82b7eb690c8df0f06f3c7ccd7a99f54"
server_key_version: "encryptionkey@0"
I20260811 07:36:10.551630 10409 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 07:36:10.556474 10435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:10.558807 10409 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:36:10.559206 10409 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "e0e704fea90844e5b9139c95795d6fd9"
format_stamp: "Formatted at 2026-08-11 07:36:10 on dist-test-slave-7z32"
server_key: "5ea65e085a86597e79910a8b7990643f"
server_key_iv: "f82b7eb690c8df0f06f3c7ccd7a99f54"
server_key_version: "encryptionkey@0"
I20260811 07:36:10.559397 10409 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:10.591831 10409 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:10.597136 10409 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:10.597388 10409 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:10.609117 10409 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:34855
I20260811 07:36:10.609416 10512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:34855 every 8 connection(s)
I20260811 07:36:10.610780 10409 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:10.613339 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 10409
I20260811 07:36:10.613525 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:36:10.613867 22547 external_mini_cluster.cc:1428] Setting key 748c742270ac735453bb20a153ba4e15
I20260811 07:36:10.616179 10513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:10.621090 10513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.4.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.253@KRBTEST.COM" created.
Aug 11 07:36:10 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:10.644935 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.624297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34855 (local address 127.0.0.1:55352)
0811 07:36:10.624944 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.625015 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:10.626125 (+ 1110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:10.627432 (+ 1307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:10.627444 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:10.628301 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:10.628724 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:10.628745 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.630741 (+ 1996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.630746 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:10.632208 (+ 1462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:10.632231 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.633338 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.633343 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:10.633585 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:10.634511 (+ 926us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:10.634536 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:10.637104 (+ 2568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:10.640246 (+ 3142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:10.640260 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:10.640275 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:10.640610 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:10.641064 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:10.641068 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:10.641070 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:10.641304 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:10.642215 (+ 911us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:10.642224 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:10.642400 (+ 176us) client_negotiation.cc:769] Sending connection context
0811 07:36:10.642671 (+ 271us) client_negotiation.cc:240] Negotiation successful
0811 07:36:10.643331 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":286,"spinlock_wait_cycles":5376,"thread_start_us":219,"threads_started":1}
I20260811 07:36:10.644935 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.625414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55352 (local address 127.22.4.254:34855)
0811 07:36:10.626077 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:10.626096 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:10.626187 (+ 91us) server_negotiation.cc:407] Connection header received
0811 07:36:10.626620 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:10.626630 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:10.627091 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:10.627351 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:10.628992 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.630455 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.632430 (+ 1975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.633049 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.633326 (+ 277us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:10.637339 (+ 4013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:10.637347 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:10.637389 (+ 42us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:10.637425 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:10.640074 (+ 2649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:10.640779 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:10.640786 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:10.640787 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:10.640942 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:10.641452 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:10.641458 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:10.641461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:10.642051 (+ 590us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:10.642248 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:10.642751 (+ 503us) server_negotiation.cc:299] Negotiation successful
0811 07:36:10.643331 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":409,"spinlock_wait_cycles":7552,"thread_start_us":143,"threads_started":1}
I20260811 07:36:10.649760 10513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:36:10.651300 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.650774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35300)
0811 07:36:10.651064 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.651196 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
W20260811 07:36:10.651889 10441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
I20260811 07:36:10.653560 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.653114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35310)
0811 07:36:10.653332 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.653411 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
W20260811 07:36:10.653874 10513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:41513: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab.
Entry for principal kudu/127.22.4.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab.
I20260811 07:36:10.656435 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.253:41513
--webserver_interface=127.22.4.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab
--principal=kudu/127.22.4.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:33567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34855,127.22.4.253:41513,127.22.4.252:38193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:36:10.703255 10513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } attempt: 1
I20260811 07:36:10.704396 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.704053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35322)
0811 07:36:10.704225 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.704307 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260811 07:36:10.705286 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.705037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35338)
0811 07:36:10.705166 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.705220 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 07:36:10.705631 10513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:41513: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
I20260811 07:36:10.773950 10513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } attempt: 2
I20260811 07:36:10.775750 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.775219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35348)
0811 07:36:10.775534 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.775640 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141}
I20260811 07:36:10.776865 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.776607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35350)
0811 07:36:10.776729 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.776793 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260811 07:36:10.777096 10513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:41513: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
W20260811 07:36:10.831454 10521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:10.831902 10521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:10.831954 10521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:10.836879 10521 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:10.836997 10521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:10.837018 10521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:10.837038 10521 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:10.837055 10521 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:10.844226 10521 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:33567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34855,127.22.4.253:41513,127.22.4.252:38193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab
--principal=kudu/127.22.4.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.253:41513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.4.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:10.846091 10521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:10.848021 10521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:36:10.862313 10521 server_base.cc:1034] running on GCE node
W20260811 07:36:10.862243 10536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:10.862640 10532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:10.862237 10533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:10.863694 10521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:10.865422 10521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:10.866938 10521 hybrid_clock.cc:648] HybridClock initialized: now 1786433770866890 us; error 50 us; skew 500 ppm
I20260811 07:36:10.868263 10513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } attempt: 3
I20260811 07:36:10.869402 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.868948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35362)
0811 07:36:10.869188 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.869282 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 07:36:10.870422 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.870124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35376)
0811 07:36:10.870267 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.870334 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
Aug 11 07:36:10 dist-test-slave-7z32 krb5kdc[10392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260811 07:36:10.870677 10513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:41513: Network error: Client connection negotiation failed: client connection to 127.22.4.253:41513: connect: Connection refused (error 111)
I20260811 07:36:10.871024 10521 init.cc:377] Logged in from keytab as kudu/127.22.4.253@KRBTEST.COM (short username kudu)
I20260811 07:36:10.872260 10521 webserver.cc:460] Webserver started at http://127.22.4.253:39031/ using document root <none> and password file <none>
I20260811 07:36:10.872987 10521 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:10.873061 10521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:10.873323 10521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:10.876281 10521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/data/instance:
uuid: "8623b9598ac84220862a7ca8e4cb880d"
format_stamp: "Formatted at 2026-08-11 07:36:10 on dist-test-slave-7z32"
server_key: "2adca42778ff74c25e69c268ae807bb7"
server_key_iv: "f19de222a95b40db23df29a4b0c7c872"
server_key_version: "encryptionkey@0"
I20260811 07:36:10.877059 10521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/wal/instance:
uuid: "8623b9598ac84220862a7ca8e4cb880d"
format_stamp: "Formatted at 2026-08-11 07:36:10 on dist-test-slave-7z32"
server_key: "2adca42778ff74c25e69c268ae807bb7"
server_key_iv: "f19de222a95b40db23df29a4b0c7c872"
server_key_version: "encryptionkey@0"
I20260811 07:36:10.884268 10521 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 07:36:10.888502 10546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:10.891074 10521 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:36:10.891311 10521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/wal
uuid: "8623b9598ac84220862a7ca8e4cb880d"
format_stamp: "Formatted at 2026-08-11 07:36:10 on dist-test-slave-7z32"
server_key: "2adca42778ff74c25e69c268ae807bb7"
server_key_iv: "f19de222a95b40db23df29a4b0c7c872"
server_key_version: "encryptionkey@0"
I20260811 07:36:10.891507 10521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:10.912055 10521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:10.916471 10521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:10.916673 10521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:10.926304 10521 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.253:41513
I20260811 07:36:10.926440 10625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.253:41513 every 8 connection(s)
I20260811 07:36:10.927680 10521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
I20260811 07:36:10.930501 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 10521
I20260811 07:36:10.930727 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-1/wal/instance
I20260811 07:36:10.931198 22547 external_mini_cluster.cc:1428] Setting key 00f68e0d52d55ee87443e84284aa519d
I20260811 07:36:10.933111 10626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:10.939196 10626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.4.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.252@KRBTEST.COM" created.
Aug 11 07:36:10 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:10.960932 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.942074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55354 (local address 127.22.4.254:34855)
0811 07:36:10.942349 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:10.942364 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:10.943943 (+ 1579us) server_negotiation.cc:407] Connection header received
0811 07:36:10.945313 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:10.945317 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:10.945403 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:10.945500 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:10.947645 (+ 2145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.948857 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.950553 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.950947 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.951089 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:10.955624 (+ 4535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:10.955629 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:10.955631 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:10.955673 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:10.957653 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:10.958528 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:10.958532 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:10.958534 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:10.958635 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:10.959199 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:10.959203 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:10.959205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:10.959471 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:10.959602 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:10.960495 (+ 893us) server_negotiation.cc:299] Negotiation successful
0811 07:36:10.960691 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260811 07:36:10.962311 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.942585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34855 (local address 127.0.0.1:55354)
0811 07:36:10.943688 (+ 1103us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.943769 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:10.944992 (+ 1223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:10.945852 (+ 860us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:10.945867 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:10.946581 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:10.947387 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:10.947408 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.949132 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.949136 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:10.950310 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:10.950326 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.951172 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.951176 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:10.951450 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:10.952317 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:10.952349 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:10.955271 (+ 2922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:10.957864 (+ 2593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:10.957874 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:10.957913 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:10.958371 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:10.958751 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:10.958755 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:10.958758 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:10.959069 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:10.959613 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:10.959625 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:10.960101 (+ 476us) client_negotiation.cc:769] Sending connection context
0811 07:36:10.960372 (+ 271us) client_negotiation.cc:240] Negotiation successful
0811 07:36:10.960945 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":275,"threads_started":1}
I20260811 07:36:10.964788 10626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab.
Entry for principal kudu/127.22.4.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab.
I20260811 07:36:10.972414 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.252:38193
--webserver_interface=127.22.4.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab
--principal=kudu/127.22.4.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:33567
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34855,127.22.4.253:41513,127.22.4.252:38193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:36:10 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
I20260811 07:36:10.982359 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.965729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35386)
0811 07:36:10.965905 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.965926 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:10.966042 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:10.967203 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:10.967207 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:10.967498 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:10.967603 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:10.967610 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.968913 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.968919 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:10.969660 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:10.969679 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.970506 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.970511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:10.970642 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:10.971541 (+ 899us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:10.971556 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:10.973414 (+ 1858us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:10.978357 (+ 4943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:10.978361 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:10.978363 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:10.978639 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:10.979606 (+ 967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:10.979609 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:10.979610 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:10.979730 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:10.981630 (+ 1900us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:10.981633 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:10.981856 (+ 223us) client_negotiation.cc:769] Sending connection context
0811 07:36:10.982022 (+ 166us) client_negotiation.cc:240] Negotiation successful
0811 07:36:10.982201 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 07:36:10.983494 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.965996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35386 (local address 127.22.4.253:41513)
0811 07:36:10.966537 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:10.966552 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:10.966580 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:36:10.966633 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:10.966640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:10.966997 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:10.967251 (+ 254us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:10.967743 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.968748 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.969809 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:10.970367 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:10.970499 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:10.973612 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:10.973628 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:10.973652 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:10.973679 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:10.977940 (+ 4261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:10.978992 (+ 1052us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:10.979006 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:10.979009 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:10.979350 (+ 341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:10.980066 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:10.980071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:10.980073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:10.981353 (+ 1280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:10.981673 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:10.982213 (+ 540us) server_negotiation.cc:299] Negotiation successful
0811 07:36:10.982506 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":159,"threads_started":1}
I20260811 07:36:10.988550 10626 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:36:10.989663 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.989296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43070)
0811 07:36:10.989465 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.989574 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260811 07:36:10.990192 10555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
I20260811 07:36:10.992594 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:10.992125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43080)
0811 07:36:10.992440 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:10.992512 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212}
W20260811 07:36:10.992759 10626 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:38193: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
I20260811 07:36:11.013949 10513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } attempt: 4
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
I20260811 07:36:11.026626 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.014943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35402)
0811 07:36:11.015169 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.015189 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:11.015312 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:11.015681 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:11.015684 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:11.015930 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:11.016054 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.016060 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.016891 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.016896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.017454 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.017463 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.018009 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.018012 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.018134 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.018729 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:11.018742 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:11.020895 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:11.023785 (+ 2890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.023789 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.023791 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.024291 (+ 500us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.024935 (+ 644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.024939 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.024941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.025073 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.025678 (+ 605us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:11.025682 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:11.025803 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 07:36:11.026175 (+ 372us) client_negotiation.cc:240] Negotiation successful
0811 07:36:11.026411 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113}
I20260811 07:36:11.026626 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.015074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35402 (local address 127.22.4.253:41513)
0811 07:36:11.015321 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.015327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.015347 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:36:11.015505 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.015508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.015568 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.015660 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.016178 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.016762 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.017577 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.017854 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.018001 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.021127 (+ 3126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.021132 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.021134 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.021163 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.023606 (+ 2443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.024519 (+ 913us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.024524 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.024528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.024755 (+ 227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.025298 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.025304 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.025306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.025558 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.025675 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.026257 (+ 582us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.026411 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260811 07:36:11.028720 10513 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:36:11.029667 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.029368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43088)
0811 07:36:11.029520 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.029590 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 07:36:11.031283 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.030599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43092)
0811 07:36:11.031031 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.031203 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206}
W20260811 07:36:11.031633 10513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:38193: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
I20260811 07:36:11.042243 10626 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } attempt: 1
I20260811 07:36:11.043643 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.043078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43102)
0811 07:36:11.043362 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.043481 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260811 07:36:11.044760 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.044433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43114)
0811 07:36:11.044594 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.044674 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 07:36:11.045046 10626 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:38193: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
I20260811 07:36:11.091053 10513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } attempt: 1
I20260811 07:36:11.092356 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.091919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43118)
0811 07:36:11.092181 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.092248 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260811 07:36:11.093456 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.092942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43132)
0811 07:36:11.093202 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.093321 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
W20260811 07:36:11.093717 10513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:38193: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
I20260811 07:36:11.113300 10626 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } attempt: 2
I20260811 07:36:11.114698 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.114169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43136)
0811 07:36:11.114504 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.114592 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
I20260811 07:36:11.115895 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.115598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43152)
0811 07:36:11.115746 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.115820 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 07:36:11.116050 10626 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:38193: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
I20260811 07:36:11.160959 10513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } attempt: 2
I20260811 07:36:11.162343 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.161784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43168)
0811 07:36:11.162058 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.162182 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260811 07:36:11.163643 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.163271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43174)
0811 07:36:11.163459 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.163531 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
W20260811 07:36:11.163827 10513 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:38193: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
W20260811 07:36:11.166307 10635 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:11.166733 10635 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:11.166836 10635 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:11.172428 10635 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:11.172565 10635 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:11.172590 10635 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:11.172610 10635 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:11.172628 10635 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:11.180864 10635 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:33567
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34855,127.22.4.253:41513,127.22.4.252:38193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab
--principal=kudu/127.22.4.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.252:38193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.4.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10635
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:11.182816 10635 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:11.184635 10635 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:11.197738 10644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:11.197805 10650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:11.197743 10646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:11.198341 10635 server_base.cc:1034] running on GCE node
I20260811 07:36:11.199257 10635 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:11.200706 10635 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:11.202119 10635 hybrid_clock.cc:648] HybridClock initialized: now 1786433771202062 us; error 73 us; skew 500 ppm
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:11.205997 10635 init.cc:377] Logged in from keytab as kudu/127.22.4.252@KRBTEST.COM (short username kudu)
I20260811 07:36:11.207247 10626 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } attempt: 3
I20260811 07:36:11.207471 10635 webserver.cc:460] Webserver started at http://127.22.4.252:36891/ using document root <none> and password file <none>
I20260811 07:36:11.208264 10635 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:11.208381 10635 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:11.208410 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.207988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43188)
0811 07:36:11.208189 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.208270 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 07:36:11.208722 10635 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:11.209635 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.209194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43196)
0811 07:36:11.209490 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.209551 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211}
W20260811 07:36:11.210000 10626 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:38193: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
I20260811 07:36:11.211705 10635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/data/instance:
uuid: "336b3dee296c481a8db1bbc71608d7a7"
format_stamp: "Formatted at 2026-08-11 07:36:11 on dist-test-slave-7z32"
server_key: "04ef0168333006f27c2caded15c501ea"
server_key_iv: "b626f710a54fc5f50e3b6ec67afe2e44"
server_key_version: "encryptionkey@0"
I20260811 07:36:11.212335 10635 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/wal/instance:
uuid: "336b3dee296c481a8db1bbc71608d7a7"
format_stamp: "Formatted at 2026-08-11 07:36:11 on dist-test-slave-7z32"
server_key: "04ef0168333006f27c2caded15c501ea"
server_key_iv: "b626f710a54fc5f50e3b6ec67afe2e44"
server_key_version: "encryptionkey@0"
I20260811 07:36:11.217347 10635 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260811 07:36:11.221091 10662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:11.223421 10635 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:36:11.223631 10635 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/wal
uuid: "336b3dee296c481a8db1bbc71608d7a7"
format_stamp: "Formatted at 2026-08-11 07:36:11 on dist-test-slave-7z32"
server_key: "04ef0168333006f27c2caded15c501ea"
server_key_iv: "b626f710a54fc5f50e3b6ec67afe2e44"
server_key_version: "encryptionkey@0"
I20260811 07:36:11.223762 10635 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:11.248961 10635 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:11.254272 10635 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:11.254495 10635 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:11.264032 10513 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } attempt: 3
I20260811 07:36:11.265061 10635 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.252:38193
I20260811 07:36:11.265152 10742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.252:38193 every 8 connection(s)
I20260811 07:36:11.265564 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.264833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43210)
0811 07:36:11.265346 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.265447 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:38193: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216}
I20260811 07:36:11.267019 10635 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
I20260811 07:36:11.271297 10743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:11.272729 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 10635
I20260811 07:36:11.272933 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786433529403386-22547-0/minicluster-data/master-2/wal/instance
I20260811 07:36:11.273355 22547 external_mini_cluster.cc:1428] Setting key 2ec52b42191a2cd8560687c73fef2bc0
I20260811 07:36:11.278316 10743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
I20260811 07:36:11.287636 10516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.266333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43212)
0811 07:36:11.266464 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.266482 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:11.266613 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:11.270599 (+ 3986us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:11.270604 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:11.270972 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:11.271154 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.271164 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.273242 (+ 2078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.273248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.274115 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.274136 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.276065 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.276072 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.276275 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.277230 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:11.277251 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:11.279773 (+ 2522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:11.283888 (+ 4115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.283896 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.283900 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.284270 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.285326 (+ 1056us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.285333 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.285338 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.285514 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.286943 (+ 1429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:11.286946 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:11.287111 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 07:36:11.287238 (+ 127us) client_negotiation.cc:240] Negotiation successful
0811 07:36:11.287442 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 07:36:11.289885 10745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.267710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43212 (local address 127.22.4.252:38193)
0811 07:36:11.268372 (+ 662us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.268404 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.268575 (+ 171us) server_negotiation.cc:407] Connection header received
0811 07:36:11.269585 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.269613 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.270125 (+ 512us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.270669 (+ 544us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.271336 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.272913 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.274636 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.275751 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.276061 (+ 310us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.280128 (+ 4067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.280136 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.280161 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.280207 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.283696 (+ 3489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.284616 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.284623 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.284631 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.285135 (+ 504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.285791 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.285797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.285801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.286653 (+ 852us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.286812 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.288425 (+ 1613us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.288793 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":464,"thread_start_us":238,"threads_started":1}
I20260811 07:36:11.290086 10747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.274329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43224 (local address 127.22.4.252:38193)
0811 07:36:11.275080 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.275112 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.275136 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:36:11.275332 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.275336 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.275421 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.275547 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.277422 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.278348 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.279913 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.280269 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.280425 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.283962 (+ 3537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.283970 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.283977 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.284011 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.286923 (+ 2912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.287502 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.287506 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.287507 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.287606 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.288004 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.288010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.288012 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.288230 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.288466 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.289488 (+ 1022us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.289617 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":217,"threads_started":1}
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:11.297688 10513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: Bootstrap starting.
I20260811 07:36:11.299124 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.281028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34855 (local address 127.0.0.1:55360)
0811 07:36:11.282791 (+ 1763us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.282945 (+ 154us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:11.283144 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:11.284067 (+ 923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:11.284075 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:11.285046 (+ 971us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:11.285263 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.285279 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.287112 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.287115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.288279 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.288291 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.289354 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.289358 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.289462 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.291360 (+ 1898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:11.291375 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:11.293419 (+ 2044us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:11.296234 (+ 2815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.296253 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.296263 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.296949 (+ 686us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.297362 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.297366 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.297368 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.297481 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.298165 (+ 684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:11.298175 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:11.298397 (+ 222us) client_negotiation.cc:769] Sending connection context
0811 07:36:11.298599 (+ 202us) client_negotiation.cc:240] Negotiation successful
0811 07:36:11.298905 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1582,"thread_start_us":142,"threads_started":1}
I20260811 07:36:11.299136 10518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.282252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55360 (local address 127.22.4.254:34855)
0811 07:36:11.282500 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.282505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.283031 (+ 526us) server_negotiation.cc:407] Connection header received
0811 07:36:11.283564 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.283572 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.283663 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.284023 (+ 360us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.286082 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.286973 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.288446 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.289173 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.289331 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.293677 (+ 4346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.293682 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.293685 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.293729 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.296073 (+ 2344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.297072 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.297076 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.297078 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.297238 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.297613 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.297617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.297618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.297995 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.298115 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.298713 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.298941 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149}
I20260811 07:36:11.301118 10743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:36:11.301425 10513 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:11.302546 10513 log.cc:824] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:11.306509 10513 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: No bootstrap required, opened a new log
I20260811 07:36:11.308766 10750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.295064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55366 (local address 127.22.4.254:34855)
0811 07:36:11.296458 (+ 1394us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.296476 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.296491 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:36:11.296534 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.296537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.296604 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.296830 (+ 226us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.297813 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.298633 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.299792 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.300196 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.300342 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.303748 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.303753 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.303756 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.303791 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.306216 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.306995 (+ 779us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.306998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.307000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.307124 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.307570 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.307574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.307576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.307883 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.308232 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.308337 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.308499 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1262,"thread_start_us":171,"threads_started":1}
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
I20260811 07:36:11.311913 10513 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.312260 10513 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:11.312403 10513 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0e704fea90844e5b9139c95795d6fd9, State: Initialized, Role: FOLLOWER
I20260811 07:36:11.313084 10513 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.314105 10632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.302211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35414 (local address 127.22.4.253:41513)
0811 07:36:11.302354 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.302361 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.302584 (+ 223us) server_negotiation.cc:407] Connection header received
0811 07:36:11.302719 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.302724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.302798 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.302981 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.303534 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.304071 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.305675 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.306204 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.306362 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.309967 (+ 3605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.309973 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.309976 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.310012 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.311883 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.312512 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.312517 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.312519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.312614 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.312970 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.312974 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.312975 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.313246 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.313330 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.313772 (+ 442us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.313937 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 07:36:11.313993 10758 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.314546 10758 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:36:11.314682 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.301900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:41513 (local address 127.0.0.1:35414)
0811 07:36:11.302461 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.302477 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:11.302598 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:11.303005 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:11.303009 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:11.303248 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:11.303378 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.303384 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.304516 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.304519 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.305465 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.305481 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.307034 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.307040 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.307162 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.307907 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:11.307924 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:11.309709 (+ 1785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:11.312057 (+ 2348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.312061 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.312063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.312364 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.312743 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.312746 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.312748 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.312855 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.313417 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:11.313422 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:11.313557 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 07:36:11.314355 (+ 798us) client_negotiation.cc:240] Negotiation successful
0811 07:36:11.314528 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484}
I20260811 07:36:11.315033 10513 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:11.316051 10743 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433771, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
W20260811 07:36:11.325166 10771 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:36:11.325300 10771 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:36:11.325366 10754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.310970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35418 (local address 127.22.4.253:41513)
0811 07:36:11.311500 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.311511 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.311528 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:36:11.311655 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.311660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.311715 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.311829 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.312694 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.313770 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.315066 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.315430 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.315555 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.319562 (+ 4007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.319569 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.319573 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.319729 (+ 156us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.322280 (+ 2551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.322996 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.323000 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.323002 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.323104 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.323437 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.323440 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.323442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.323724 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.323951 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.324899 (+ 948us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.325078 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":197,"threads_started":1}
I20260811 07:36:11.327893 10748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.316816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43240)
0811 07:36:11.317069 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.317092 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:11.317221 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:11.317608 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:11.317615 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:11.317900 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:11.318050 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.318058 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.319153 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.319156 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.319948 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.319960 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.320874 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.320877 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.320950 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.321777 (+ 827us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:11.321794 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:11.323601 (+ 1807us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:11.325884 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.325887 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.325890 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.326140 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.326584 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.326587 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.326590 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.326700 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.327319 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:11.327321 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:11.327422 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 07:36:11.327519 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 07:36:11.327701 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125}
I20260811 07:36:11.323542 10409 master_runner.cc:186] Error getting master registration for 127.22.4.253:41513: OK, instance_id { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" instance_seqno: 1786433770923499 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:36:11.328521 10747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.317138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43240 (local address 127.22.4.252:38193)
0811 07:36:11.317288 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.317293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.317309 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:36:11.317365 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.317369 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.317436 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.317538 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.318216 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.319009 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.320115 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.320615 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.320728 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.323763 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.323767 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.323770 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.323793 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.325721 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.326246 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.326250 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.326251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.326325 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.326806 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.326810 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.326814 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.327173 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.327282 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.328254 (+ 972us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.328389 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 07:36:11.328918 10409 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:36:11.330927 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:36:11.334362 10743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7: Bootstrap starting.
I20260811 07:36:11.338949 10743 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:11.340483 10743 log.cc:824] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:11.343539 10750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.333862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55380 (local address 127.22.4.254:34855)
0811 07:36:11.334015 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.334020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.334035 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:36:11.334093 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.334095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.334139 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.334237 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.335351 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.336137 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.337017 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.337301 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.337430 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.339194 (+ 1764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.339201 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.339204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.339239 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.341370 (+ 2131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.341924 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.341928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.341930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.342034 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.342366 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.342369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.342371 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.342627 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.342754 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.343204 (+ 450us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.343349 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:36:11.344781 10743 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7: No bootstrap required, opened a new log
I20260811 07:36:11.350528 10747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.335495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43248 (local address 127.22.4.252:38193)
0811 07:36:11.335625 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.335631 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.339590 (+ 3959us) server_negotiation.cc:407] Connection header received
0811 07:36:11.339820 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.339824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.339903 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.339976 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.341163 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.341961 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.343155 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.343475 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.343570 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.345726 (+ 2156us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.345730 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.345732 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.345763 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.347682 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.348424 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.348429 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.348433 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.348543 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.348892 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.348897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.348899 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.349164 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.349289 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.349768 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.350244 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
W20260811 07:36:11.350656 10445 tablet.cc:2369] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:11.352062 10743 raft_consensus.cc:348] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.352471 10743 raft_consensus.cc:374] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:11.352538 10743 raft_consensus.cc:729] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 336b3dee296c481a8db1bbc71608d7a7, State: Initialized, Role: FOLLOWER
I20260811 07:36:11.353195 10626 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } attempt: 4
I20260811 07:36:11.353343 10743 consensus_queue.cc:260] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.354487 10754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.334704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35432 (local address 127.22.4.253:41513)
0811 07:36:11.335012 (+ 308us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.335018 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.339308 (+ 4290us) server_negotiation.cc:407] Connection header received
0811 07:36:11.339433 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.339437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.339533 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.339686 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.344146 (+ 4460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.344981 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.346335 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.346907 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.347061 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.349015 (+ 1954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.349019 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.349022 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.349053 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.352303 (+ 3250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.352857 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.352861 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.352863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.352973 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.353324 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.353328 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.353331 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.353608 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.353744 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.354165 (+ 421us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.354307 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:36:11.355489 10743 sys_catalog.cc:564] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 07:36:11 dist-test-slave-7z32 krb5kdc[10392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433770, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
I20260811 07:36:11.365895 10785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.366199 10785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:36:11.366401 10804 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:36:11.366528 10804 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:36:11.368526 10629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.353689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:38193 (local address 127.0.0.1:43256)
0811 07:36:11.353973 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:11.353988 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:11.354072 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:11.354729 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:11.354732 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:11.354955 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:11.355066 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.355080 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.356071 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.356075 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.356814 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:11.356830 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.357433 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.357437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:11.357534 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.358138 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:11.358152 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:11.362719 (+ 4567us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:11.365091 (+ 2372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.365095 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.365097 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.365410 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.365933 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:11.365941 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:11.365946 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:11.366653 (+ 707us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:11.367429 (+ 776us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:11.367434 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:11.367575 (+ 141us) client_negotiation.cc:769] Sending connection context
0811 07:36:11.368014 (+ 439us) client_negotiation.cc:240] Negotiation successful
0811 07:36:11.368288 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199}
I20260811 07:36:11.369693 10747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:11.354231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43256 (local address 127.22.4.252:38193)
0811 07:36:11.354352 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:11.354357 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:11.354370 (+ 13us) server_negotiation.cc:407] Connection header received
0811 07:36:11.354409 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:11.354412 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:11.354464 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:11.354544 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:11.355203 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.355922 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.357006 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:11.357285 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:11.357405 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:11.362940 (+ 5535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:11.362944 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:11.362947 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:11.362976 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:11.364953 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.365581 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.365586 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.365591 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.365692 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:11.366889 (+ 1197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:11.366895 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:11.366897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:11.367247 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:11.367373 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:11.369262 (+ 1889us) server_negotiation.cc:299] Negotiation successful
0811 07:36:11.369476 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 07:36:11.374032 10626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: Bootstrap starting.
I20260811 07:36:11.374423 10635 master_runner.cc:186] Error getting master registration for 127.22.4.253:41513: OK, instance_id { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" instance_seqno: 1786433770923499 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:36:11.378911 10635 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:36:11.379740 10626 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:11.381275 10626 log.cc:824] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:11.389197 10626 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: No bootstrap required, opened a new log
I20260811 07:36:11.395519 10626 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.396005 10626 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:11.396085 10626 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8623b9598ac84220862a7ca8e4cb880d, State: Initialized, Role: FOLLOWER
I20260811 07:36:11.396796 10626 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.398952 10626 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:11.399621 10810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.399930 10810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:36:11.410324 10824 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:36:11.410569 10824 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:36:11.414685 10521 master_runner.cc:263] No leader master found from master 8623b9598ac84220862a7ca8e4cb880d
I20260811 07:36:11.414816 10521 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:36:11.416940 10785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:11.417217 10785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.418519 10785 leader_election.cc:288] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0e704fea90844e5b9139c95795d6fd9 (127.22.4.254:34855), 8623b9598ac84220862a7ca8e4cb880d (127.22.4.253:41513)
W20260811 07:36:11.419027 10558 tablet.cc:2369] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:11.419615 10479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "336b3dee296c481a8db1bbc71608d7a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e704fea90844e5b9139c95795d6fd9" is_pre_election: true
I20260811 07:36:11.419989 10479 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 336b3dee296c481a8db1bbc71608d7a7 in term 0.
I20260811 07:36:11.420578 10665 leader_election.cc:302] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 336b3dee296c481a8db1bbc71608d7a7, e0e704fea90844e5b9139c95795d6fd9; no voters:
I20260811 07:36:11.421514 10587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "336b3dee296c481a8db1bbc71608d7a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8623b9598ac84220862a7ca8e4cb880d" is_pre_election: true
I20260811 07:36:11.421866 10587 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 336b3dee296c481a8db1bbc71608d7a7 in term 0.
I20260811 07:36:11.422681 10785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:36:11.422811 10785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:36:11.422922 10785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:11.424705 10785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.428675 10479 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "336b3dee296c481a8db1bbc71608d7a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e704fea90844e5b9139c95795d6fd9"
I20260811 07:36:11.428866 10479 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:11.430682 10479 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 336b3dee296c481a8db1bbc71608d7a7 in term 1.
I20260811 07:36:11.431282 10665 leader_election.cc:302] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 336b3dee296c481a8db1bbc71608d7a7, e0e704fea90844e5b9139c95795d6fd9; no voters:
I20260811 07:36:11.432849 10587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "336b3dee296c481a8db1bbc71608d7a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8623b9598ac84220862a7ca8e4cb880d"
I20260811 07:36:11.433040 10587 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:11.434636 10587 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 336b3dee296c481a8db1bbc71608d7a7 in term 1.
I20260811 07:36:11.435276 10785 leader_election.cc:288] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [CANDIDATE]: Term 1 election: Requested vote from peers e0e704fea90844e5b9139c95795d6fd9 (127.22.4.254:34855), 8623b9598ac84220862a7ca8e4cb880d (127.22.4.253:41513)
I20260811 07:36:11.435535 10785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:11.435674 10785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [term 1 LEADER]: Becoming Leader. State: Replica: 336b3dee296c481a8db1bbc71608d7a7, State: Running, Role: LEADER
I20260811 07:36:11.436137 10785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } }
I20260811 07:36:11.438359 10785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 336b3dee296c481a8db1bbc71608d7a7. Latest consensus state: current_term: 1 leader_uuid: "336b3dee296c481a8db1bbc71608d7a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.438513 10785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:11.439107 10829 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:11.440284 10829 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:11.452610 10587 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [term 1 FOLLOWER]: Refusing update from remote peer 336b3dee296c481a8db1bbc71608d7a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:11.453495 10827 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:11.463132 10810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 336b3dee296c481a8db1bbc71608d7a7. Latest consensus state: current_term: 1 leader_uuid: "336b3dee296c481a8db1bbc71608d7a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.463357 10810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:36:11.465035 10479 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [term 1 FOLLOWER]: Refusing update from remote peer 336b3dee296c481a8db1bbc71608d7a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:11.465894 10827 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:11.474435 10758 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 336b3dee296c481a8db1bbc71608d7a7. Latest consensus state: current_term: 1 leader_uuid: "336b3dee296c481a8db1bbc71608d7a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.474645 10758 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:36:11.486994 10827 sys_catalog.cc:455] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "336b3dee296c481a8db1bbc71608d7a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.487208 10827 sys_catalog.cc:458] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:11.495325 10758 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "336b3dee296c481a8db1bbc71608d7a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.495576 10758 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:36:11.496351 10830 mvcc.cc:205] Tried to move back new op lower bound from 7317232727858733056 to 7317232727806484480. Current Snapshot: MvccSnapshot[applied={T|T < 7317232727858733056}]
I20260811 07:36:11.496935 10833 mvcc.cc:205] Tried to move back new op lower bound from 7317232727858733056 to 7317232727806484480. Current Snapshot: MvccSnapshot[applied={T|T < 7317232727858733056}]
I20260811 07:36:11.498931 10785 sys_catalog.cc:455] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "336b3dee296c481a8db1bbc71608d7a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.499285 10785 sys_catalog.cc:458] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:11.501396 10810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "336b3dee296c481a8db1bbc71608d7a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e704fea90844e5b9139c95795d6fd9" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34855 } } peers { permanent_uuid: "8623b9598ac84220862a7ca8e4cb880d" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 41513 } } peers { permanent_uuid: "336b3dee296c481a8db1bbc71608d7a7" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 38193 } } }
I20260811 07:36:11.501600 10810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:36:11.502717 10831 mvcc.cc:205] Tried to move back new op lower bound from 7317232727858733056 to 7317232727806484480. Current Snapshot: MvccSnapshot[applied={T|T < 7317232727858733056}]
I20260811 07:36:11.511955 10829 catalog_manager.cc:1347] Generated new cluster ID: 021c3a10258c43e0aa0af971eb467b17
I20260811 07:36:11.512087 10829 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:36:11.543797 10829 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:36:11.549723 10829 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:36:11.580163 10829 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 336b3dee296c481a8db1bbc71608d7a7: Generated new TSK 0
I20260811 07:36:11.581265 10829 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:36:12.327881 10771 catalog_manager.cc:1259] Loaded cluster ID: 021c3a10258c43e0aa0af971eb467b17
I20260811 07:36:12.328099 10771 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: loading cluster ID for follower catalog manager: success
I20260811 07:36:12.330634 10771 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: acquiring CA information for follower catalog manager: success
I20260811 07:36:12.332403 10771 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e0e704fea90844e5b9139c95795d6fd9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:36:12.412809 10824 catalog_manager.cc:1259] Loaded cluster ID: 021c3a10258c43e0aa0af971eb467b17
I20260811 07:36:12.412935 10824 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: loading cluster ID for follower catalog manager: success
I20260811 07:36:12.416190 10824 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: acquiring CA information for follower catalog manager: success
I20260811 07:36:12.418690 10824 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8623b9598ac84220862a7ca8e4cb880d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:36:12.669751 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 10409
I20260811 07:36:12.686658 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 10521
I20260811 07:36:12.706336 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 10635
2026-08-11T07:36:12Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3963 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:36:12 dist-test-slave-7z32 krb5kdc[10849](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:36:12 dist-test-slave-7z32 krb5kdc[10849](info): set up 2 sockets
Aug 11 07:36:12 dist-test-slave-7z32 krb5kdc[10849](info): commencing operation
krb5kdc: starting...
W20260811 07:36:14.167133 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.419s user 0.000s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:36:14 dist-test-slave-7z32 krb5kdc[10849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:36:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:36:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:36:14.372538 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:46231
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:46749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:46231
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:14.521697 10870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:14.522107 10870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:14.522192 10870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:14.526672 10870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:14.526815 10870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:14.526877 10870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:14.526911 10870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:14.526949 10870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:14.534207 10870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:46749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:46231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:46231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:14.536053 10870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:14.537707 10870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:14.552440 10881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:14.552454 10879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:14.552454 10878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:14.553117 10870 server_base.cc:1034] running on GCE node
I20260811 07:36:14.554101 10870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:14.556089 10870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:14.559609 10870 hybrid_clock.cc:648] HybridClock initialized: now 1786433774559530 us; error 119 us; skew 500 ppm
Aug 11 07:36:14 dist-test-slave-7z32 krb5kdc[10849](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433774, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:14.563361 10870 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:14.564700 10870 webserver.cc:460] Webserver started at http://127.22.4.254:40583/ using document root <none> and password file <none>
I20260811 07:36:14.565392 10870 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:14.565477 10870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:14.565729 10870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:14.568233 10870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "c7b03c862c0e4c60b40d0a615048fb0a"
format_stamp: "Formatted at 2026-08-11 07:36:14 on dist-test-slave-7z32"
server_key: "0d7fa7becab3ac1127973d388ee2fc5a"
server_key_iv: "b469bd6daf7af3b709f0ecbf781fdf52"
server_key_version: "encryptionkey@0"
I20260811 07:36:14.568966 10870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "c7b03c862c0e4c60b40d0a615048fb0a"
format_stamp: "Formatted at 2026-08-11 07:36:14 on dist-test-slave-7z32"
server_key: "0d7fa7becab3ac1127973d388ee2fc5a"
server_key_iv: "b469bd6daf7af3b709f0ecbf781fdf52"
server_key_version: "encryptionkey@0"
I20260811 07:36:14.574118 10870 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:36:14.577775 10893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:14.579932 10870 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:36:14.580118 10870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "c7b03c862c0e4c60b40d0a615048fb0a"
format_stamp: "Formatted at 2026-08-11 07:36:14 on dist-test-slave-7z32"
server_key: "0d7fa7becab3ac1127973d388ee2fc5a"
server_key_iv: "b469bd6daf7af3b709f0ecbf781fdf52"
server_key_version: "encryptionkey@0"
I20260811 07:36:14.580312 10870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:14.600282 10870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:14.604482 10870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:14.604689 10870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:14.613736 10870 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:46231
I20260811 07:36:14.613901 10959 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:46231 every 8 connection(s)
I20260811 07:36:14.614967 10870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:14.615269 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 10870
I20260811 07:36:14.615444 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:36:14.615984 22547 external_mini_cluster.cc:1428] Setting key 27558d94e099863b0dbd1712a4c8d670
I20260811 07:36:14.620051 10961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 11 07:36:14 dist-test-slave-7z32 krb5kdc[10849](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433774, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:14.628646 10961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a: Bootstrap starting.
I20260811 07:36:14.632359 10961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:14.633605 10961 log.cc:824] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:14.637099 10964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:14.618008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52066 (local address 127.22.4.254:46231)
0811 07:36:14.618718 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:14.618739 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:14.618788 (+ 49us) server_negotiation.cc:407] Connection header received
0811 07:36:14.620014 (+ 1226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:14.620041 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:14.620641 (+ 600us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:14.621210 (+ 569us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:14.622318 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:14.623791 (+ 1473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:14.624849 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:14.625687 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:14.626023 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:14.629995 (+ 3972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:14.630004 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:14.630033 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:14.630091 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:14.632384 (+ 2293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:14.633318 (+ 934us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:14.633326 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:14.633336 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:14.633547 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:14.634001 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:14.634006 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:14.634007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:14.634865 (+ 858us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:14.635086 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:14.635684 (+ 598us) server_negotiation.cc:299] Negotiation successful
0811 07:36:14.636095 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":250,"threads_started":1}
I20260811 07:36:14.637404 10961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a: No bootstrap required, opened a new log
I20260811 07:36:14.642537 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:36:14.643851 10961 raft_consensus.cc:348] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b03c862c0e4c60b40d0a615048fb0a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46231 } }
I20260811 07:36:14.644351 10961 raft_consensus.cc:374] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:14.644454 10961 raft_consensus.cc:729] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7b03c862c0e4c60b40d0a615048fb0a, State: Initialized, Role: FOLLOWER
I20260811 07:36:14.645184 10961 consensus_queue.cc:260] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b03c862c0e4c60b40d0a615048fb0a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46231 } }
I20260811 07:36:14.645435 10961 raft_consensus.cc:388] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:36:14.645555 10961 raft_consensus.cc:482] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:36:14.645706 10961 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:14.647500 10961 raft_consensus.cc:504] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b03c862c0e4c60b40d0a615048fb0a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46231 } }
I20260811 07:36:14.648080 10961 leader_election.cc:302] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c7b03c862c0e4c60b40d0a615048fb0a; no voters:
I20260811 07:36:14.648765 10961 leader_election.cc:288] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:36:14.649075 10967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:14.649606 10967 raft_consensus.cc:686] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [term 1 LEADER]: Becoming Leader. State: Replica: c7b03c862c0e4c60b40d0a615048fb0a, State: Running, Role: LEADER
I20260811 07:36:14.650099 10967 consensus_queue.cc:237] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b03c862c0e4c60b40d0a615048fb0a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46231 } }
I20260811 07:36:14.650753 10961 sys_catalog.cc:564] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:14.652459 10969 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c7b03c862c0e4c60b40d0a615048fb0a. Latest consensus state: current_term: 1 leader_uuid: "c7b03c862c0e4c60b40d0a615048fb0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b03c862c0e4c60b40d0a615048fb0a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46231 } } }
I20260811 07:36:14.652694 10969 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:14.653082 10968 sys_catalog.cc:455] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c7b03c862c0e4c60b40d0a615048fb0a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c7b03c862c0e4c60b40d0a615048fb0a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46231 } } }
I20260811 07:36:14.653236 10968 sys_catalog.cc:458] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:14.653208 10983 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:14.657656 10983 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:14.666250 10983 catalog_manager.cc:1347] Generated new cluster ID: cfedfce4350c4c2680c71fbc21828ddb
I20260811 07:36:14.666375 10983 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:36:14.678797 10983 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:36:14.681110 10983 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:36:14.694118 10983 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c7b03c862c0e4c60b40d0a615048fb0a: Generated new TSK 0
I20260811 07:36:14.696257 10983 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:36:14.702315 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 10870
2026-08-11T07:36:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1995 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:36:14 dist-test-slave-7z32 krb5kdc[11002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:36:14 dist-test-slave-7z32 krb5kdc[11002](info): set up 2 sockets
Aug 11 07:36:14 dist-test-slave-7z32 krb5kdc[11002](info): commencing operation
krb5kdc: starting...
W20260811 07:36:16.121438 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.378s user 0.008s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:36:16 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:36:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:36:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:36:16.321127 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37457
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:37457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:16.488705 11026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:16.489202 11026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:16.489283 11026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:16.495127 11026 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:16.495303 11026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:16.495349 11026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:16.495398 11026 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:16.495445 11026 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:16.502869 11026 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:37457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:16.504586 11026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:16.506071 11026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:16.518927 11035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:16.518949 11031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:16.518957 11037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:16.519941 11026 server_base.cc:1034] running on GCE node
I20260811 07:36:16.520980 11026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:16.523177 11026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:16.524631 11026 hybrid_clock.cc:648] HybridClock initialized: now 1786433776524584 us; error 73 us; skew 500 ppm
Aug 11 07:36:16 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:16.529639 11026 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:16.531306 11026 webserver.cc:460] Webserver started at http://127.22.4.254:43931/ using document root <none> and password file <none>
I20260811 07:36:16.532172 11026 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:16.532290 11026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:16.532644 11026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:16.535759 11026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "b40f7b6069764d9a8ed743dfe8929f78"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "42b671569be32f90cd7eef31bcfcca87"
server_key_iv: "b692e6e863bfd3c1a41df35515f2a60e"
server_key_version: "encryptionkey@0"
I20260811 07:36:16.536609 11026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "b40f7b6069764d9a8ed743dfe8929f78"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "42b671569be32f90cd7eef31bcfcca87"
server_key_iv: "b692e6e863bfd3c1a41df35515f2a60e"
server_key_version: "encryptionkey@0"
I20260811 07:36:16.543535 11026 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 07:36:16.548964 11052 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:16.551308 11026 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:36:16.551620 11026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b40f7b6069764d9a8ed743dfe8929f78"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "42b671569be32f90cd7eef31bcfcca87"
server_key_iv: "b692e6e863bfd3c1a41df35515f2a60e"
server_key_version: "encryptionkey@0"
I20260811 07:36:16.551847 11026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:16.580964 11026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:16.586580 11026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:16.587102 11026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:16.598495 11026 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:37457
I20260811 07:36:16.598987 11131 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:37457 every 8 connection(s)
I20260811 07:36:16.600140 11026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:16.604287 11133 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:16.605464 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 11026
I20260811 07:36:16.605667 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:36:16.606150 22547 external_mini_cluster.cc:1428] Setting key 689c5b7cb1c905bae754c51b96d6e0ad
I20260811 07:36:16.613365 11133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Bootstrap starting.
I20260811 07:36:16.616938 11133 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:16.618155 11133 log.cc:824] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:36:16 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433776, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:16.621625 11133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: No bootstrap required, opened a new log
I20260811 07:36:16.625986 11133 raft_consensus.cc:348] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:16.626441 11133 raft_consensus.cc:374] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:16.626561 11133 raft_consensus.cc:729] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b40f7b6069764d9a8ed743dfe8929f78, State: Initialized, Role: FOLLOWER
I20260811 07:36:16.627231 11133 consensus_queue.cc:260] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:16.627450 11133 raft_consensus.cc:388] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:36:16.627547 11133 raft_consensus.cc:482] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:36:16.627718 11133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:16.628067 11140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:16.608379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51460 (local address 127.22.4.254:37457)
0811 07:36:16.609066 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:16.609098 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:16.609154 (+ 56us) server_negotiation.cc:407] Connection header received
0811 07:36:16.610134 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:16.610163 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:16.611075 (+ 912us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:16.611563 (+ 488us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:16.612814 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:16.614206 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:16.615789 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:16.616599 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:16.616804 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:16.620907 (+ 4103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:16.620916 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:16.620943 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:16.620987 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:16.623444 (+ 2457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:16.624150 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:16.624157 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:16.624165 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:16.624326 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:16.624697 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:16.624701 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:16.624702 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:16.625327 (+ 625us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:16.625664 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:16.625962 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 07:36:16.626461 (+ 499us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":439,"thread_start_us":222,"threads_started":1}
I20260811 07:36:16.629103 11133 raft_consensus.cc:504] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:16.629611 11133 leader_election.cc:302] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b40f7b6069764d9a8ed743dfe8929f78; no voters:
I20260811 07:36:16.630113 11133 leader_election.cc:288] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:36:16.630374 11142 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:16.630748 11142 raft_consensus.cc:686] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 1 LEADER]: Becoming Leader. State: Replica: b40f7b6069764d9a8ed743dfe8929f78, State: Running, Role: LEADER
I20260811 07:36:16.631294 11142 consensus_queue.cc:237] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:16.632085 11133 sys_catalog.cc:564] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:16.633813 11143 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b40f7b6069764d9a8ed743dfe8929f78. Latest consensus state: current_term: 1 leader_uuid: "b40f7b6069764d9a8ed743dfe8929f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } } }
I20260811 07:36:16.634044 11143 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:16.634714 11159 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:16.634768 11144 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b40f7b6069764d9a8ed743dfe8929f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } } }
I20260811 07:36:16.635326 11144 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:16.639199 11159 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:16.647974 11159 catalog_manager.cc:1347] Generated new cluster ID: 719b01db4b3f4a4c8e7b0646d485b52c
I20260811 07:36:16.648128 11159 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:36:16.665395 11159 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:36:16.667662 11159 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:36:16.686596 11159 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Generated new TSK 0
I20260811 07:36:16.687783 11159 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:36:16.744637 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37457
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:16.924526 11169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:16.925057 11169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:16.925175 11169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:16.930491 11169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:16.930647 11169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:16.930773 11169 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:36:16.938395 11169 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11169
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:16.940408 11169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:16.943048 11169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:16.964682 11178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:16.964696 11176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:16.964742 11175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:16.965046 11169 server_base.cc:1034] running on GCE node
I20260811 07:36:16.965798 11169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:16.966624 11169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:16.967947 11169 hybrid_clock.cc:648] HybridClock initialized: now 1786433776967918 us; error 56 us; skew 500 ppm
Aug 11 07:36:16 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:16.972100 11169 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:36:16.973431 11169 webserver.cc:460] Webserver started at http://127.22.4.193:34777/ using document root <none> and password file <none>
I20260811 07:36:16.974189 11169 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:16.974278 11169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:16.974540 11169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:16.978103 11169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "fa00daf6eb6145c09099f2ae3e55d615"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "3d1266209b34b74862086f96de3d55d8"
server_key_iv: "e7376aaea8be4167448b751c141580e8"
server_key_version: "encryptionkey@0"
I20260811 07:36:16.979223 11169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "fa00daf6eb6145c09099f2ae3e55d615"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "3d1266209b34b74862086f96de3d55d8"
server_key_iv: "e7376aaea8be4167448b751c141580e8"
server_key_version: "encryptionkey@0"
I20260811 07:36:16.985873 11169 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:36:16.990060 11196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:16.992367 11169 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:36:16.992619 11169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "fa00daf6eb6145c09099f2ae3e55d615"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "3d1266209b34b74862086f96de3d55d8"
server_key_iv: "e7376aaea8be4167448b751c141580e8"
server_key_version: "encryptionkey@0"
I20260811 07:36:16.992796 11169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:17.022902 11169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:17.028546 11169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:17.028813 11169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:17.029575 11169 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:17.030647 11169 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:17.030725 11169 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:17.030802 11169 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:17.030872 11169 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260811 07:36:17.043931 11169 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:35667
I20260811 07:36:17.043954 11366 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:35667 every 8 connection(s)
I20260811 07:36:17.045104 11169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:36:17.049060 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 11169
I20260811 07:36:17.049245 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:36:17.049779 22547 external_mini_cluster.cc:1428] Setting key 17384c0ab11e9d62482245bcf4177ff2
Aug 11 07:36:17 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433776, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:36:17.066560 11140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.048491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:55569 (local address 127.22.4.254:37457)
0811 07:36:17.048766 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.048773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.050491 (+ 1718us) server_negotiation.cc:407] Connection header received
0811 07:36:17.052644 (+ 2153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.052649 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.052826 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.052967 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:17.055186 (+ 2219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.055857 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.057683 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.058064 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.058204 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.061719 (+ 3515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:17.061723 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:17.061725 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:17.061758 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:17.063779 (+ 2021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:17.064514 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:17.064517 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:17.064519 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:17.064604 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:17.065114 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:17.065121 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:17.065122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:17.065361 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:17.065477 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.066156 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.066350 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:36:17.068471 11370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.049179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:55569)
0811 07:36:17.050148 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:17.050265 (+ 117us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:17.052330 (+ 2065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:17.053255 (+ 925us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:17.053268 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:17.053868 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:17.054878 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.054913 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.056104 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.056108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.057487 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.057502 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.058338 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.058345 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.058599 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.059560 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:17.059582 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:17.061468 (+ 1886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:17.063934 (+ 2466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:17.063942 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:17.063973 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:17.064387 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:17.064757 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:17.064760 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:17.064763 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:17.064992 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:17.065478 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:17.065489 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:17.065854 (+ 365us) client_negotiation.cc:769] Sending connection context
0811 07:36:17.066091 (+ 237us) client_negotiation.cc:240] Negotiation successful
0811 07:36:17.066707 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":252,"threads_started":1}
I20260811 07:36:17.070880 11367 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37457
I20260811 07:36:17.071285 11367 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:17.072144 11367 heartbeater.cc:511] Master 127.22.4.254:37457 requested a full tablet report, sending...
I20260811 07:36:17.074870 11082 ts_manager.cc:194] Registered new tserver with Master: fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667)
I20260811 07:36:17.077308 11082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:55569
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:36:17.095788 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37457
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:17.261901 11374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:17.262514 11374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:17.262669 11374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:17.268651 11374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:17.268810 11374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:17.268893 11374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:36:17.279265 11374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:17.281035 11374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:17.282719 11374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:17.297184 11380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:17.297068 11382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:17.297115 11374 server_base.cc:1034] running on GCE node
W20260811 07:36:17.297262 11384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:17.298076 11374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:17.299207 11374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:17.302719 11374 hybrid_clock.cc:648] HybridClock initialized: now 1786433777302572 us; error 153 us; skew 500 ppm
Aug 11 07:36:17 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:17.307399 11374 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:36:17.308738 11374 webserver.cc:460] Webserver started at http://127.22.4.194:37235/ using document root <none> and password file <none>
I20260811 07:36:17.309526 11374 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:17.309609 11374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:17.309893 11374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:17.312736 11374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "f332a5c42903433a8b274157ed0b66cc"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "efa6bdd303ff69d89605c1e758ca0876"
server_key_iv: "fc2abe6c0faec9622f2adbfba3c3a363"
server_key_version: "encryptionkey@0"
I20260811 07:36:17.313509 11374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "f332a5c42903433a8b274157ed0b66cc"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "efa6bdd303ff69d89605c1e758ca0876"
server_key_iv: "fc2abe6c0faec9622f2adbfba3c3a363"
server_key_version: "encryptionkey@0"
I20260811 07:36:17.319415 11374 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260811 07:36:17.323400 11395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:17.325608 11374 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:36:17.325816 11374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "f332a5c42903433a8b274157ed0b66cc"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "efa6bdd303ff69d89605c1e758ca0876"
server_key_iv: "fc2abe6c0faec9622f2adbfba3c3a363"
server_key_version: "encryptionkey@0"
I20260811 07:36:17.326043 11374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:17.348836 11374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:17.352906 11374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:17.353147 11374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:17.353927 11374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:17.355022 11374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:17.355093 11374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:17.355170 11374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:17.355209 11374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:17.367806 11374 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:42161
I20260811 07:36:17.367867 11578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:42161 every 8 connection(s)
I20260811 07:36:17.369071 11374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:36:17.379227 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 11374
I20260811 07:36:17.379395 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:36:17.379766 22547 external_mini_cluster.cc:1428] Setting key c58c97f929d543f2bc2febcd72e0225c
Aug 11 07:36:17 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:17.388993 11140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.372481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:51771 (local address 127.22.4.254:37457)
0811 07:36:17.372735 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.372741 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.374431 (+ 1690us) server_negotiation.cc:407] Connection header received
0811 07:36:17.376386 (+ 1955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.376391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.376491 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.376621 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:17.378569 (+ 1948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.379514 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.381273 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.381585 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.381715 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.384923 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:17.384927 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:17.384929 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:17.384960 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:17.386537 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:17.387219 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:17.387223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:17.387225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:17.387314 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:17.387692 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:17.387696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:17.387697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:17.387923 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:17.388032 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.388640 (+ 608us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.388792 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260811 07:36:17.390256 11581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.373194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:51771)
0811 07:36:17.374106 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:17.374218 (+ 112us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:17.375954 (+ 1736us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:17.376898 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:17.376909 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:17.377529 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:17.378297 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.378316 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.379755 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.379760 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.381098 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.381117 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.381969 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.381974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.382187 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.382950 (+ 763us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:17.382971 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:17.384689 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:17.386689 (+ 2000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:17.386697 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:17.386717 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:17.387107 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:17.387412 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:17.387416 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:17.387418 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:17.387583 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:17.388034 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:17.388044 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:17.388362 (+ 318us) client_negotiation.cc:769] Sending connection context
0811 07:36:17.388576 (+ 214us) client_negotiation.cc:240] Negotiation successful
0811 07:36:17.388985 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":210,"threads_started":1}
I20260811 07:36:17.392366 11579 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37457
I20260811 07:36:17.392942 11579 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:17.394040 11579 heartbeater.cc:511] Master 127.22.4.254:37457 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:36:17.396245 11082 ts_manager.cc:194] Registered new tserver with Master: f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161)
I20260811 07:36:17.397207 11082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:51771
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:36:17.423189 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37457
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:17.595127 11585 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:17.595526 11585 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:17.595582 11585 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:17.600383 11585 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:17.600503 11585 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:17.600587 11585 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:36:17.607424 11585 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11585
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:17.609932 11585 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:17.611753 11585 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:17.626955 11591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:17.627020 11585 server_base.cc:1034] running on GCE node
W20260811 07:36:17.626999 11593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:17.626955 11590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:17.628006 11585 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:17.629027 11585 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:17.630379 11585 hybrid_clock.cc:648] HybridClock initialized: now 1786433777630300 us; error 79 us; skew 500 ppm
Aug 11 07:36:17 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:17.635354 11585 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:36:17.636948 11585 webserver.cc:460] Webserver started at http://127.22.4.195:46207/ using document root <none> and password file <none>
I20260811 07:36:17.637831 11585 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:17.637954 11585 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:17.638317 11585 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:17.641569 11585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "d7c2901524e2487aa3a6a6e4e05a13af"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "25c6a3237890070761e841a8221b034a"
server_key_iv: "16113e7ef6e4ce196c263095d3843eb3"
server_key_version: "encryptionkey@0"
I20260811 07:36:17.642438 11585 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "d7c2901524e2487aa3a6a6e4e05a13af"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "25c6a3237890070761e841a8221b034a"
server_key_iv: "16113e7ef6e4ce196c263095d3843eb3"
server_key_version: "encryptionkey@0"
I20260811 07:36:17.648523 11585 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 07:36:17.652863 11606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:17.655354 11585 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:36:17.655635 11585 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "d7c2901524e2487aa3a6a6e4e05a13af"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "25c6a3237890070761e841a8221b034a"
server_key_iv: "16113e7ef6e4ce196c263095d3843eb3"
server_key_version: "encryptionkey@0"
I20260811 07:36:17.655859 11585 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:17.681041 11585 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:17.686259 11585 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:17.686566 11585 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:17.687542 11585 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:17.688802 11585 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:17.688885 11585 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:17.688966 11585 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:17.689011 11585 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:17.703043 11585 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:46671
I20260811 07:36:17.703094 11780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:46671 every 8 connection(s)
I20260811 07:36:17.704453 11585 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:36:17.706167 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 11585
I20260811 07:36:17.706349 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:36:17.706719 22547 external_mini_cluster.cc:1428] Setting key 0fec890952ba2d2d4bc26b8208312960
Aug 11 07:36:17 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433777, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:17.726348 11140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.707567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:42421 (local address 127.22.4.254:37457)
0811 07:36:17.707730 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.707735 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.709762 (+ 2027us) server_negotiation.cc:407] Connection header received
0811 07:36:17.712096 (+ 2334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.712099 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.712178 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.712327 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:17.714104 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.714805 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.716735 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.717026 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.717319 (+ 293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.721212 (+ 3893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:17.721215 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:17.721218 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:17.721281 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:17.723549 (+ 2268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:17.724326 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:17.724330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:17.724332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:17.724438 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:17.724872 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:17.724876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:17.724878 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:17.725132 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:17.725257 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.725956 (+ 699us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.726134 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:36:17.727658 11788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.708386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:42421)
0811 07:36:17.709525 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:17.709601 (+ 76us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:17.711783 (+ 2182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:17.712632 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:17.712642 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:17.713183 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:17.713859 (+ 676us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.713877 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.715112 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.715115 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.716444 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.716460 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.717433 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.717437 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.717637 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.718541 (+ 904us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:17.718564 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:17.720909 (+ 2345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:17.723751 (+ 2842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:17.723761 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:17.723785 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:17.724199 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:17.724542 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:17.724546 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:17.724548 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:17.724760 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:17.725272 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:17.725284 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:17.725651 (+ 367us) client_negotiation.cc:769] Sending connection context
0811 07:36:17.725911 (+ 260us) client_negotiation.cc:240] Negotiation successful
0811 07:36:17.726404 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":207,"threads_started":1}
I20260811 07:36:17.729525 11781 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37457
I20260811 07:36:17.730023 11781 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:17.730978 11781 heartbeater.cc:511] Master 127.22.4.254:37457 requested a full tablet report, sending...
I20260811 07:36:17.732939 11082 ts_manager.cc:194] Registered new tserver with Master: d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671)
I20260811 07:36:17.733968 11082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:42421
I20260811 07:36:17.736105 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:36:17.748745 11140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.738964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51476 (local address 127.22.4.254:37457)
0811 07:36:17.739174 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.739179 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.739551 (+ 372us) server_negotiation.cc:407] Connection header received
0811 07:36:17.739742 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.739745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.739797 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.739958 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:17.741021 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.741618 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.742544 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.742783 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.742950 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.744810 (+ 1860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:17.744814 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:17.744816 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:17.744850 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:17.746457 (+ 1607us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:17.747072 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:17.747080 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:17.747081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:17.747205 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:17.747594 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:17.747597 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:17.747599 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:17.747909 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:17.748072 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.748410 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.748553 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 07:36:17.753993 11080 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51476:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:36:17.759078 11080 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:36:17.782676 11811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.774280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52430 (local address 127.22.4.195:46671)
0811 07:36:17.774909 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.774925 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.775580 (+ 655us) server_negotiation.cc:407] Connection header received
0811 07:36:17.776044 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.776049 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.776324 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.776636 (+ 312us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:17.777318 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.778335 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.780383 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.781372 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.781489 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.781690 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.782240 (+ 550us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.782469 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":467,"thread_start_us":188,"threads_started":1}
I20260811 07:36:17.782676 11805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.774096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:46671 (local address 127.0.0.1:52430)
0811 07:36:17.775347 (+ 1251us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:17.775432 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:17.775660 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:17.776937 (+ 1277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:17.776940 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:17.776963 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:17.777136 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.777147 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.778524 (+ 1377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.778527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.780163 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.780180 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.781823 (+ 1643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.781826 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.781986 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.782031 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 07:36:17.782185 (+ 154us) client_negotiation.cc:240] Negotiation successful
0811 07:36:17.782469 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1019,"mutex_wait_us":65,"spinlock_wait_cycles":25856,"thread_start_us":170,"threads_started":1}
I20260811 07:36:17.782704 11803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.774058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:42161 (local address 127.0.0.1:36418)
0811 07:36:17.775354 (+ 1296us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:17.775432 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:17.775660 (+ 228us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:17.776703 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:17.776712 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:17.776745 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:17.776964 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.776973 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.778955 (+ 1982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.778959 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.780163 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.780180 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.781554 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.781702 (+ 148us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.782059 (+ 357us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.782108 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 07:36:17.782238 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 07:36:17.782400 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":995,"mutex_wait_us":43,"spinlock_wait_cycles":384,"thread_start_us":209,"threads_started":1}
I20260811 07:36:17.783546 11810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.774256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36418 (local address 127.22.4.194:42161)
0811 07:36:17.774908 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.774925 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.775901 (+ 976us) server_negotiation.cc:407] Connection header received
0811 07:36:17.776042 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.776049 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.776323 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.776636 (+ 313us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:17.777239 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.778731 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.780389 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.781372 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.781513 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.781689 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.782877 (+ 1188us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.783098 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":208,"threads_started":1}
I20260811 07:36:17.784283 11812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.775379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35667 (local address 127.0.0.1:58568)
0811 07:36:17.776423 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:17.776442 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:17.776616 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:17.777544 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:17.777664 (+ 120us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:17.777696 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:17.777816 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.777824 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.779449 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.779455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.780677 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.780687 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.782575 (+ 1888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.782580 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.782716 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.782756 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 07:36:17.783747 (+ 991us) client_negotiation.cc:240] Negotiation successful
0811 07:36:17.783875 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":940,"thread_start_us":367,"threads_started":1}
I20260811 07:36:17.784677 11813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.775768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58568 (local address 127.22.4.193:35667)
0811 07:36:17.776510 (+ 742us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.776522 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.776557 (+ 35us) server_negotiation.cc:407] Connection header received
0811 07:36:17.776819 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.776827 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.777165 (+ 338us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.778003 (+ 838us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:17.778186 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.779315 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.780853 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.782111 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.782272 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.782484 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.784247 (+ 1763us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.784443 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":129,"threads_started":1}
I20260811 07:36:17.787850 11683 tablet_service.cc:1467] Processing CreateTablet for tablet 6244894c567b449b9e722f48f3b9699f (DEFAULT_TABLE table=test-table [id=baeba6ffc7054846abae953ba2ff3f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:17.787850 11463 tablet_service.cc:1467] Processing CreateTablet for tablet 6244894c567b449b9e722f48f3b9699f (DEFAULT_TABLE table=test-table [id=baeba6ffc7054846abae953ba2ff3f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:17.788798 11276 tablet_service.cc:1467] Processing CreateTablet for tablet 6244894c567b449b9e722f48f3b9699f (DEFAULT_TABLE table=test-table [id=baeba6ffc7054846abae953ba2ff3f2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:17.789496 11463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6244894c567b449b9e722f48f3b9699f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:17.789496 11683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6244894c567b449b9e722f48f3b9699f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:17.790416 11276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6244894c567b449b9e722f48f3b9699f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:17.804327 11818 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Bootstrap starting.
I20260811 07:36:17.804313 11817 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Bootstrap starting.
I20260811 07:36:17.805362 11815 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Bootstrap starting.
I20260811 07:36:17.807420 11818 tablet_bootstrap.cc:654] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:17.808434 11818 log.cc:824] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:17.808593 11817 tablet_bootstrap.cc:654] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:17.808629 11815 tablet_bootstrap.cc:654] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:17.810004 11815 log.cc:824] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:17.810004 11817 log.cc:824] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:17.811239 11818 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: No bootstrap required, opened a new log
I20260811 07:36:17.811529 11818 ts_tablet_manager.cc:1397] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 07:36:17.813300 11815 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: No bootstrap required, opened a new log
I20260811 07:36:17.813300 11817 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: No bootstrap required, opened a new log
I20260811 07:36:17.813625 11815 ts_tablet_manager.cc:1397] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 07:36:17.813623 11817 ts_tablet_manager.cc:1397] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 07:36:17.816823 11818 raft_consensus.cc:348] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:17.817224 11818 raft_consensus.cc:374] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:17.817293 11818 raft_consensus.cc:729] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa00daf6eb6145c09099f2ae3e55d615, State: Initialized, Role: FOLLOWER
I20260811 07:36:17.817902 11818 consensus_queue.cc:260] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:17.818909 11367 heartbeater.cc:503] Master 127.22.4.254:37457 was elected leader, sending a full tablet report...
I20260811 07:36:17.819372 11818 ts_tablet_manager.cc:1428] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 07:36:17.819162 11815 raft_consensus.cc:348] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:17.819628 11815 raft_consensus.cc:374] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:17.819703 11815 raft_consensus.cc:729] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c2901524e2487aa3a6a6e4e05a13af, State: Initialized, Role: FOLLOWER
I20260811 07:36:17.819497 11817 raft_consensus.cc:348] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:17.819783 11817 raft_consensus.cc:374] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:17.819831 11817 raft_consensus.cc:729] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f332a5c42903433a8b274157ed0b66cc, State: Initialized, Role: FOLLOWER
I20260811 07:36:17.820403 11815 consensus_queue.cc:260] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:17.820403 11817 consensus_queue.cc:260] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:17.821858 11579 heartbeater.cc:503] Master 127.22.4.254:37457 was elected leader, sending a full tablet report...
I20260811 07:36:17.821923 11817 ts_tablet_manager.cc:1428] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260811 07:36:17.821903 11781 heartbeater.cc:503] Master 127.22.4.254:37457 was elected leader, sending a full tablet report...
I20260811 07:36:17.822697 11815 ts_tablet_manager.cc:1428] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
W20260811 07:36:17.870747 11580 tablet.cc:2369] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:36:17.956018 11784 tablet.cc:2369] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:17.986415 11826 raft_consensus.cc:482] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:17.986763 11826 raft_consensus.cc:504] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:17.988420 11826 leader_election.cc:288] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161), fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667)
I20260811 07:36:17.993571 11788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.988956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:42161 (local address 127.22.4.195:54053)
0811 07:36:17.989207 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:17.989232 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:17.989419 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:17.989825 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:17.989829 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:17.989864 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:17.990026 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.990033 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.991251 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.991255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.992181 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.992192 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.993076 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.993080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.993202 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.993238 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:36:17.993329 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:36:17.993437 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 07:36:17.993817 11810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.989210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:54053 (local address 127.22.4.194:42161)
0811 07:36:17.989418 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.989423 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.989447 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:36:17.989570 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.989575 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.989643 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.989752 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:17.990217 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.991073 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.992351 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.992929 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.993050 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.993110 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.993406 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.993527 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111}
I20260811 07:36:17.994102 11813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.989537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:51301 (local address 127.22.4.193:35667)
0811 07:36:17.989749 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:17.989756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:17.990031 (+ 275us) server_negotiation.cc:407] Connection header received
0811 07:36:17.990156 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:17.990162 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:17.990230 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:17.990311 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:17.990685 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.991338 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.992659 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.993211 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.993348 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.993404 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:17.993790 (+ 386us) server_negotiation.cc:299] Negotiation successful
0811 07:36:17.993946 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260811 07:36:17.994620 11829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:17.989331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35667 (local address 127.22.4.195:51301)
0811 07:36:17.989901 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:17.989925 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:17.990037 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:17.990346 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:17.990350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:17.990371 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:17.990547 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.990554 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.991510 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.991513 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.992495 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:17.992507 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:17.993421 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:17.993425 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:17.993550 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:17.993580 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:36:17.994322 (+ 742us) client_negotiation.cc:240] Negotiation successful
0811 07:36:17.994492 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":150,"threads_started":1}
I20260811 07:36:17.994789 11493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6244894c567b449b9e722f48f3b9699f" candidate_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f332a5c42903433a8b274157ed0b66cc" is_pre_election: true
I20260811 07:36:17.995349 11493 raft_consensus.cc:2454] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7c2901524e2487aa3a6a6e4e05a13af in term 0.
I20260811 07:36:17.995544 11302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6244894c567b449b9e722f48f3b9699f" candidate_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa00daf6eb6145c09099f2ae3e55d615" is_pre_election: true
I20260811 07:36:17.995911 11302 raft_consensus.cc:2454] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7c2901524e2487aa3a6a6e4e05a13af in term 0.
I20260811 07:36:17.996168 11607 leader_election.cc:302] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7c2901524e2487aa3a6a6e4e05a13af, f332a5c42903433a8b274157ed0b66cc; no voters:
I20260811 07:36:17.996603 11826 raft_consensus.cc:2781] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:36:17.996841 11826 raft_consensus.cc:482] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:36:17.996935 11826 raft_consensus.cc:3037] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:17.998675 11826 raft_consensus.cc:504] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:17.999239 11826 leader_election.cc:288] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [CANDIDATE]: Term 1 election: Requested vote from peers f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161), fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667)
I20260811 07:36:18.000048 11493 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6244894c567b449b9e722f48f3b9699f" candidate_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f332a5c42903433a8b274157ed0b66cc"
I20260811 07:36:18.000164 11302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6244894c567b449b9e722f48f3b9699f" candidate_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa00daf6eb6145c09099f2ae3e55d615"
I20260811 07:36:18.000291 11493 raft_consensus.cc:3037] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:18.000443 11302 raft_consensus.cc:3037] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:18.001924 11302 raft_consensus.cc:2454] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7c2901524e2487aa3a6a6e4e05a13af in term 1.
I20260811 07:36:18.001987 11493 raft_consensus.cc:2454] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7c2901524e2487aa3a6a6e4e05a13af in term 1.
I20260811 07:36:18.002496 11607 leader_election.cc:302] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7c2901524e2487aa3a6a6e4e05a13af, fa00daf6eb6145c09099f2ae3e55d615; no voters:
I20260811 07:36:18.002887 11826 raft_consensus.cc:2781] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:18.003270 11826 raft_consensus.cc:686] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 1 LEADER]: Becoming Leader. State: Replica: d7c2901524e2487aa3a6a6e4e05a13af, State: Running, Role: LEADER
I20260811 07:36:18.003957 11826 consensus_queue.cc:237] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:18.008972 11082 catalog_manager.cc:5495] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af reported cstate change: term changed from 0 to 1, leader changed from <none> to d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195). New cstate: current_term: 1 leader_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } health_report { overall_health: HEALTHY } } }
I20260811 07:36:18.040886 11811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:18.036538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52440 (local address 127.22.4.195:46671)
0811 07:36:18.036748 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:18.036753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:18.036768 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:36:18.036916 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:18.036919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:18.036988 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:18.037125 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:36:18.037454 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.038032 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.039065 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.039299 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.039422 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:18.039814 (+ 392us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:36:18.040367 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:36:18.040525 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:18.040595 (+ 70us) server_negotiation.cc:299] Negotiation successful
0811 07:36:18.040674 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
W20260811 07:36:18.047581 11368 tablet.cc:2369] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:18.051607 11493 raft_consensus.cc:1261] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 1 FOLLOWER]: Refusing update from remote peer d7c2901524e2487aa3a6a6e4e05a13af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:18.051743 11302 raft_consensus.cc:1261] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Refusing update from remote peer d7c2901524e2487aa3a6a6e4e05a13af: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:18.052772 11826 consensus_queue.cc:1035] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [LEADER]: Connected to new peer: Peer: permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:18.053107 11830 consensus_queue.cc:1035] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:18.066794 11839 mvcc.cc:205] Tried to move back new op lower bound from 7317232754886635520 to 7317232754708430848. Current Snapshot: MvccSnapshot[applied={T|T < 7317232754886635520}]
I20260811 07:36:18.082546 11078 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:36:18.082859 11078 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51476:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:36:18.086815 11078 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Sending DeleteTablet for 3 replicas of tablet 6244894c567b449b9e722f48f3b9699f
I20260811 07:36:18.088229 11683 tablet_service.cc:1514] Processing DeleteTablet for tablet 6244894c567b449b9e722f48f3b9699f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:18 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:52430
I20260811 07:36:18.088356 11276 tablet_service.cc:1514] Processing DeleteTablet for tablet 6244894c567b449b9e722f48f3b9699f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:18 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:58568
I20260811 07:36:18.088367 11463 tablet_service.cc:1514] Processing DeleteTablet for tablet 6244894c567b449b9e722f48f3b9699f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:18 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:36418
I20260811 07:36:18.089071 11854 tablet_replica.cc:330] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: stopping tablet replica
I20260811 07:36:18.089336 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 11169
I20260811 07:36:18.140828 11852 tablet_replica.cc:330] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: stopping tablet replica
I20260811 07:36:18.141309 11850 tablet_replica.cc:330] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: stopping tablet replica
I20260811 07:36:18.141709 11852 raft_consensus.cc:2229] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:36:18.141897 11850 raft_consensus.cc:2229] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:36:18.142437 11852 raft_consensus.cc:2258] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:18.142577 11850 raft_consensus.cc:2258] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:18.145030 11852 ts_tablet_manager.cc:1905] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:18.145031 11850 ts_tablet_manager.cc:1905] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:18.149304 11852 ts_tablet_manager.cc:1918] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:18.149304 11850 ts_tablet_manager.cc:1918] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:18.149493 11850 log.cc:1196] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/6244894c567b449b9e722f48f3b9699f
I20260811 07:36:18.149838 11852 log.cc:1196] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/6244894c567b449b9e722f48f3b9699f
I20260811 07:36:18.150166 11850 ts_tablet_manager.cc:1939] T 6244894c567b449b9e722f48f3b9699f P d7c2901524e2487aa3a6a6e4e05a13af: Deleting consensus metadata
I20260811 07:36:18.150671 11852 ts_tablet_manager.cc:1939] T 6244894c567b449b9e722f48f3b9699f P f332a5c42903433a8b274157ed0b66cc: Deleting consensus metadata
W20260811 07:36:18.152110 11053 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:35667 (error 108)
I20260811 07:36:18.152864 11053 catalog_manager.cc:4841] TS f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161): tablet 6244894c567b449b9e722f48f3b9699f (table test-table [id=baeba6ffc7054846abae953ba2ff3f2b]) successfully deleted
I20260811 07:36:18.153766 11056 catalog_manager.cc:4841] TS d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671): tablet 6244894c567b449b9e722f48f3b9699f (table test-table [id=baeba6ffc7054846abae953ba2ff3f2b]) successfully deleted
W20260811 07:36:18.153985 11812 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:36:18.153286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35667 (local address 127.0.0.1:58576)
0811 07:36:18.153493 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:18.153713 (+ 220us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:18.153838 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:35667: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":86}
W20260811 07:36:18.154208 11053 catalog_manager.cc:4584] TS fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6244894c567b449b9e722f48f3b9699f: Network error: Client connection negotiation failed: client connection to 127.22.4.193:35667: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260811 07:36:18.154326 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 11374
I20260811 07:36:18.179344 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 11585
I20260811 07:36:18.203154 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 11026
I20260811 07:36:18.224454 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37457
--webserver_interface=127.22.4.254
--webserver_port=43931
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:37457
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:18.397854 11857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:18.398316 11857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:18.398444 11857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:18.403055 11857 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:18.403162 11857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:18.403183 11857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:18.403201 11857 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:18.403221 11857 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:18.412317 11857 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:37457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=43931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:18.414376 11857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:18.416311 11857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:18.439986 11867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:18.439904 11864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:18.440062 11865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:18.440670 11857 server_base.cc:1034] running on GCE node
I20260811 07:36:18.441629 11857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:18.443404 11857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:18.446947 11857 hybrid_clock.cc:648] HybridClock initialized: now 1786433778446860 us; error 96 us; skew 500 ppm
Aug 11 07:36:18 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:18.457793 11857 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:18.459288 11857 webserver.cc:460] Webserver started at http://127.22.4.254:43931/ using document root <none> and password file <none>
I20260811 07:36:18.460085 11857 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:18.460220 11857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:18.465977 11857 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:36:18.469586 11879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:18.472085 11857 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:36:18.472345 11857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b40f7b6069764d9a8ed743dfe8929f78"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "42b671569be32f90cd7eef31bcfcca87"
server_key_iv: "b692e6e863bfd3c1a41df35515f2a60e"
server_key_version: "encryptionkey@0"
I20260811 07:36:18.473240 11857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:18.507294 11857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:18.511448 11857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:18.511719 11857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:18.522460 11857 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:37457
I20260811 07:36:18.523058 11958 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:37457 every 8 connection(s)
I20260811 07:36:18.524271 11857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:18.529670 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 11857
I20260811 07:36:18.530654 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:35667
--local_ip_for_outbound_sockets=127.22.4.193
--tserver_master_addrs=127.22.4.254:37457
--webserver_port=34777
--webserver_interface=127.22.4.193
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:36:18.533140 11959 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:36:18.536482 11959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Bootstrap starting.
I20260811 07:36:18.564335 11959 log.cc:824] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:18.577647 11959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:36:18.578361 11959 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Bootstrap complete.
I20260811 07:36:18.585413 11959 raft_consensus.cc:348] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:18.586143 11959 raft_consensus.cc:729] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b40f7b6069764d9a8ed743dfe8929f78, State: Initialized, Role: FOLLOWER
I20260811 07:36:18.587006 11959 consensus_queue.cc:260] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:18.587239 11959 raft_consensus.cc:388] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:36:18.587352 11959 raft_consensus.cc:482] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:36:18.587498 11959 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:36:18.590684 11959 raft_consensus.cc:504] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:18.591321 11959 leader_election.cc:302] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b40f7b6069764d9a8ed743dfe8929f78; no voters:
I20260811 07:36:18.591841 11959 leader_election.cc:288] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:36:18.591974 11963 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:36:18.592254 11963 raft_consensus.cc:686] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 2 LEADER]: Becoming Leader. State: Replica: b40f7b6069764d9a8ed743dfe8929f78, State: Running, Role: LEADER
I20260811 07:36:18.592656 11963 consensus_queue.cc:237] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:18.593674 11959 sys_catalog.cc:564] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:18.594012 11963 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b40f7b6069764d9a8ed743dfe8929f78. Latest consensus state: current_term: 2 leader_uuid: "b40f7b6069764d9a8ed743dfe8929f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } } }
I20260811 07:36:18.594158 11963 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:18.594754 11971 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:18.594630 11964 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b40f7b6069764d9a8ed743dfe8929f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } } }
I20260811 07:36:18.595010 11964 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:18.602139 11971 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:18.603106 11971 catalog_manager.cc:1259] Loaded cluster ID: 719b01db4b3f4a4c8e7b0646d485b52c
I20260811 07:36:18.603188 11971 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:36:18.604949 11971 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 07:36:18.609911 11971 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 07:36:18.618527 11971 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:36:18.620024 11971 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Loaded TSK: 0
I20260811 07:36:18.621910 11971 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:36:18.690193 11961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:18.690689 11961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:18.690798 11961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:18.695560 11961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:18.695673 11961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:18.695773 11961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:36:18.707202 11961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:35667
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=34777
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:18.710438 11961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:18.712440 11961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:18.728201 12000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:18.728196 12002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:18.728569 12004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:18.729065 11961 server_base.cc:1034] running on GCE node
I20260811 07:36:18.729943 11961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:18.730942 11961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:18.732249 11961 hybrid_clock.cc:648] HybridClock initialized: now 1786433778732219 us; error 61 us; skew 500 ppm
Aug 11 07:36:18 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:18.736416 11961 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:36:18.737949 11961 webserver.cc:460] Webserver started at http://127.22.4.193:34777/ using document root <none> and password file <none>
I20260811 07:36:18.738708 11961 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:18.738873 11961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:18.744937 11961 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260811 07:36:18.748350 12013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:18.750475 11961 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:36:18.750721 11961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "fa00daf6eb6145c09099f2ae3e55d615"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "3d1266209b34b74862086f96de3d55d8"
server_key_iv: "e7376aaea8be4167448b751c141580e8"
server_key_version: "encryptionkey@0"
I20260811 07:36:18.751503 11961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:18.788570 11961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:18.793239 11961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:18.793542 11961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:18.794477 11961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:18.796455 12024 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:36:18.806521 11961 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:36:18.806704 11961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.011s user 0.001s sys 0.000s
I20260811 07:36:18.806810 11961 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:36:18.810300 11961 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:36:18.810400 11961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.001s sys 0.000s
I20260811 07:36:18.811180 12024 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Bootstrap starting.
I20260811 07:36:18.829391 11961 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:35667
I20260811 07:36:18.829882 12199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:35667 every 8 connection(s)
I20260811 07:36:18.831738 11961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:36:18.837209 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 11961
I20260811 07:36:18.837713 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:42161
--local_ip_for_outbound_sockets=127.22.4.194
--tserver_master_addrs=127.22.4.254:37457
--webserver_port=37235
--webserver_interface=127.22.4.194
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:36:18.847895 12024 log.cc:824] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:36:18 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:18.864578 12024 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:36:18.865445 12024 tablet_bootstrap.cc:492] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Bootstrap complete.
I20260811 07:36:18.866191 12204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:18.835304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:48917 (local address 127.22.4.254:37457)
0811 07:36:18.836554 (+ 1250us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:18.836575 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:18.836633 (+ 58us) server_negotiation.cc:407] Connection header received
0811 07:36:18.837991 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:18.838089 (+ 98us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:18.838943 (+ 854us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:18.839705 (+ 762us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:18.843591 (+ 3886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.845732 (+ 2141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.850157 (+ 4425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.851497 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.852010 (+ 513us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:18.857369 (+ 5359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:18.857379 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:18.857402 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:18.857459 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:18.860298 (+ 2839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:18.861182 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:18.861191 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:18.861197 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:18.861395 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:18.861866 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:18.861869 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:18.861871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:18.862475 (+ 604us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:18.862624 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:18.863781 (+ 1157us) server_negotiation.cc:299] Negotiation successful
0811 07:36:18.864411 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1048,"thread_start_us":300,"threads_started":1}
I20260811 07:36:18.867997 12024 ts_tablet_manager.cc:1397] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Time spent bootstrapping tablet: real 0.057s user 0.032s sys 0.023s
I20260811 07:36:18.868515 12203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:18.835101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:48917)
0811 07:36:18.835776 (+ 675us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:18.835842 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:18.837014 (+ 1172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:18.840733 (+ 3719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:18.840756 (+ 23us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:18.841536 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:18.843123 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:18.843168 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.846308 (+ 3140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.846316 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:18.849545 (+ 3229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:18.849785 (+ 240us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.852375 (+ 2590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.852384 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:18.852669 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:18.854276 (+ 1607us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:18.854307 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:18.856931 (+ 2624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:18.860532 (+ 3601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:18.860541 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:18.860568 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:18.861001 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:18.861535 (+ 534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:18.861538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:18.861540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:18.861739 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:18.862724 (+ 985us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:18.862732 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:18.863129 (+ 397us) client_negotiation.cc:769] Sending connection context
0811 07:36:18.865057 (+ 1928us) client_negotiation.cc:240] Negotiation successful
0811 07:36:18.865673 (+ 616us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":225,"threads_started":1}
I20260811 07:36:18.872824 12200 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37457
I20260811 07:36:18.873221 12200 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:18.872620 12024 raft_consensus.cc:348] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:18.873476 12024 raft_consensus.cc:729] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa00daf6eb6145c09099f2ae3e55d615, State: Initialized, Role: FOLLOWER
I20260811 07:36:18.874145 12200 heartbeater.cc:511] Master 127.22.4.254:37457 requested a full tablet report, sending...
I20260811 07:36:18.874225 12024 consensus_queue.cc:260] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } }
I20260811 07:36:18.876143 12024 ts_tablet_manager.cc:1428] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
I20260811 07:36:18.879141 11903 ts_manager.cc:194] Registered new tserver with Master: fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667)
I20260811 07:36:18.884963 11903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:48917
I20260811 07:36:18.889047 12200 heartbeater.cc:503] Master 127.22.4.254:37457 was elected leader, sending a full tablet report...
Aug 11 07:36:18 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433778, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:36:18.900197 12214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:18.884052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35667 (local address 127.0.0.1:57776)
0811 07:36:18.884691 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:18.884763 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:18.885000 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:18.886036 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:18.886044 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:18.886698 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:18.886923 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:18.886935 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.888179 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.888185 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:18.888952 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:18.888964 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.890125 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.890128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:18.890300 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:18.891193 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:18.891215 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:18.894209 (+ 2994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:18.897424 (+ 3215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:18.897444 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:18.897457 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:18.897886 (+ 429us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:18.898352 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:18.898355 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:18.898356 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:18.898462 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:18.899351 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:18.899359 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:18.899540 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 07:36:18.899718 (+ 178us) client_negotiation.cc:240] Negotiation successful
0811 07:36:18.899994 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":215,"threads_started":1}
I20260811 07:36:18.900333 12215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:18.884294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57776 (local address 127.22.4.193:35667)
0811 07:36:18.885441 (+ 1147us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:18.885454 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:18.885483 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:36:18.885580 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:18.885585 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:18.885817 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:18.886015 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:18.887097 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.888018 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.889150 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:18.889786 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:18.889919 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:18.894534 (+ 4615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:18.894556 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:18.894575 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:18.894629 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:18.897189 (+ 2560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:18.898063 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:18.898070 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:18.898073 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:18.898208 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:18.898576 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:18.898580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:18.898582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:18.899177 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:18.899352 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:18.899867 (+ 515us) server_negotiation.cc:299] Negotiation successful
0811 07:36:18.900127 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":1004,"thread_start_us":199,"threads_started":1}
I20260811 07:36:18.902798 12077 tablet_service.cc:1514] Processing DeleteTablet for tablet 6244894c567b449b9e722f48f3b9699f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:18 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:57776
I20260811 07:36:18.904220 12216 tablet_replica.cc:330] stopping tablet replica
I20260811 07:36:18.904682 12216 raft_consensus.cc:2229] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:36:18.905033 12216 raft_consensus.cc:2258] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:18.906680 12216 ts_tablet_manager.cc:1905] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:18.912712 12216 ts_tablet_manager.cc:1918] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:18.912921 12216 log.cc:1196] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/6244894c567b449b9e722f48f3b9699f
I20260811 07:36:18.913270 12216 ts_tablet_manager.cc:1939] T 6244894c567b449b9e722f48f3b9699f P fa00daf6eb6145c09099f2ae3e55d615: Deleting consensus metadata
I20260811 07:36:18.916252 11881 catalog_manager.cc:4841] TS fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667): tablet 6244894c567b449b9e722f48f3b9699f (table test-table [id=baeba6ffc7054846abae953ba2ff3f2b]) successfully deleted
W20260811 07:36:19.000862 12206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:19.001228 12206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:19.001281 12206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:19.006598 12206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:19.006721 12206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:19.006788 12206 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:36:19.013196 12206 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:42161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=37235
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:19.014642 12206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:19.016005 12206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:19.030239 12223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:19.030575 12222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:19.030611 12206 server_base.cc:1034] running on GCE node
W20260811 07:36:19.030187 12225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:19.031455 12206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:19.032544 12206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:19.036017 12206 hybrid_clock.cc:648] HybridClock initialized: now 1786433779035913 us; error 82 us; skew 500 ppm
Aug 11 07:36:19 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433779, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:19.041538 12206 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:36:19.042999 12206 webserver.cc:460] Webserver started at http://127.22.4.194:37235/ using document root <none> and password file <none>
I20260811 07:36:19.043725 12206 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:19.043829 12206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:19.049329 12206 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:36:19.052739 12234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:19.055387 12206 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:36:19.055586 12206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "f332a5c42903433a8b274157ed0b66cc"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "efa6bdd303ff69d89605c1e758ca0876"
server_key_iv: "fc2abe6c0faec9622f2adbfba3c3a363"
server_key_version: "encryptionkey@0"
I20260811 07:36:19.056362 12206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:19.073544 12206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:19.078107 12206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:19.078469 12206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:19.079360 12206 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:19.080737 12206 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:19.080818 12206 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:19.080893 12206 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:19.080930 12206 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:19.097059 12206 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:42161
I20260811 07:36:19.097186 12404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:42161 every 8 connection(s)
I20260811 07:36:19.098471 12206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:36:19.101897 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 12206
I20260811 07:36:19.102644 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:46671
--local_ip_for_outbound_sockets=127.22.4.195
--tserver_master_addrs=127.22.4.254:37457
--webserver_port=46207
--webserver_interface=127.22.4.195
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:36:19 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433779, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:19.122396 12204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.101573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:38627 (local address 127.22.4.254:37457)
0811 07:36:19.101740 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.101743 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.103741 (+ 1998us) server_negotiation.cc:407] Connection header received
0811 07:36:19.105477 (+ 1736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.105481 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.105564 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.105684 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:19.108390 (+ 2706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.108971 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.110384 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.110659 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.110790 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.114081 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:19.114091 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:19.114097 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:19.114166 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:19.117417 (+ 3251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:19.118507 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:19.118514 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:19.118516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:19.119001 (+ 485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:19.120239 (+ 1238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:19.120243 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:19.120244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:19.120688 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:19.120952 (+ 264us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.121963 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.122176 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 07:36:19.123611 12407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.102214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:38627)
0811 07:36:19.103517 (+ 1303us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.103591 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:19.105156 (+ 1565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:19.105949 (+ 793us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:19.105959 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:19.106688 (+ 729us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:19.108100 (+ 1412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.108130 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.109161 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.109164 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.110209 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.110223 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.110901 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.110906 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.111125 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.111861 (+ 736us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:19.111881 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:19.113661 (+ 1780us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:19.117715 (+ 4054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:19.117725 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:19.117751 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:19.118265 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:19.119471 (+ 1206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:19.119474 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:19.119476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:19.119881 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:19.120939 (+ 1058us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:19.120949 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:19.121611 (+ 662us) client_negotiation.cc:769] Sending connection context
0811 07:36:19.121879 (+ 268us) client_negotiation.cc:240] Negotiation successful
0811 07:36:19.122335 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":903,"thread_start_us":306,"threads_started":1}
I20260811 07:36:19.125447 12405 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37457
I20260811 07:36:19.125962 12405 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:19.126950 12405 heartbeater.cc:511] Master 127.22.4.254:37457 requested a full tablet report, sending...
I20260811 07:36:19.129050 11903 ts_manager.cc:194] Registered new tserver with Master: f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161)
I20260811 07:36:19.129992 11903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:38627
W20260811 07:36:19.296466 12410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:19.296892 12410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:19.296947 12410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:19.301792 12410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:19.301929 12410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:19.302007 12410 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:36:19.308861 12410 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:46671
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=46207
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:19.310557 12410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:19.312028 12410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:19.327369 12420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:19.327386 12418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:19.327386 12424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:19.327483 12410 server_base.cc:1034] running on GCE node
I20260811 07:36:19.328469 12410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:19.329474 12410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:19.330694 12410 hybrid_clock.cc:648] HybridClock initialized: now 1786433779330661 us; error 56 us; skew 500 ppm
Aug 11 07:36:19 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433779, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:19.335695 12410 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:36:19.337276 12410 webserver.cc:460] Webserver started at http://127.22.4.195:46207/ using document root <none> and password file <none>
I20260811 07:36:19.338140 12410 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:19.338310 12410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:19.344569 12410 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:36:19.348857 12434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:19.351373 12410 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.004s
I20260811 07:36:19.351636 12410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "d7c2901524e2487aa3a6a6e4e05a13af"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "25c6a3237890070761e841a8221b034a"
server_key_iv: "16113e7ef6e4ce196c263095d3843eb3"
server_key_version: "encryptionkey@0"
I20260811 07:36:19.352527 12410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:19.389776 12410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:19.395152 12410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:19.395466 12410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:19.396449 12410 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:19.397770 12410 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:19.397858 12410 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:19.397956 12410 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:19.398005 12410 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:19.416990 12410 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:46671
I20260811 07:36:19.417052 12616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:46671 every 8 connection(s)
I20260811 07:36:19.419180 12410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:36:19.428975 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 12410
Aug 11 07:36:19 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433779, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:19.448918 12204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.424492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:59009 (local address 127.22.4.254:37457)
0811 07:36:19.424772 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.424779 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.426242 (+ 1463us) server_negotiation.cc:407] Connection header received
0811 07:36:19.429230 (+ 2988us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.429235 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.429328 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.429494 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:19.432581 (+ 3087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.433753 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.435969 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.436414 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.436570 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.441758 (+ 5188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:19.441762 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:19.441764 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:19.441808 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:19.443646 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:19.445126 (+ 1480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:19.445134 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:19.445136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:19.445278 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:19.446159 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:19.446163 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:19.446165 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:19.446915 (+ 750us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:19.447059 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.448223 (+ 1164us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.448416 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":82,"server-negotiator.queue_time_us":108}
I20260811 07:36:19.449463 12623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.430177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32814 (local address 127.22.4.254:37457)
0811 07:36:19.430564 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.430569 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.430941 (+ 372us) server_negotiation.cc:407] Connection header received
0811 07:36:19.431008 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.431012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.431079 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.431182 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:19.432499 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.433543 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.435105 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.435508 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.435651 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.440209 (+ 4558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:19.440229 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:19.440238 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:19.440292 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:19.445157 (+ 4865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:19.446004 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:19.446011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:19.446013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:19.446156 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:19.447086 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:19.447114 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:19.447118 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:19.447542 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:19.447931 (+ 389us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.448946 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.449205 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":228,"thread_start_us":136,"threads_started":1}
I20260811 07:36:19.452363 12622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.425089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:59009)
0811 07:36:19.425953 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.426031 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:19.428717 (+ 2686us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:19.429879 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:19.429896 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:19.430742 (+ 846us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:19.432225 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.432289 (+ 64us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.433988 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.433992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.435777 (+ 1785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.435800 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.436810 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.436819 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.437184 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.438208 (+ 1024us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:19.438243 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:19.441402 (+ 3159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:19.444103 (+ 2701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:19.444118 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:19.444151 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:19.444637 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:19.445425 (+ 788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:19.445431 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:19.445433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:19.445764 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:19.447220 (+ 1456us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:19.447231 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:19.447759 (+ 528us) client_negotiation.cc:769] Sending connection context
0811 07:36:19.449448 (+ 1689us) client_negotiation.cc:240] Negotiation successful
0811 07:36:19.450127 (+ 679us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":269,"threads_started":1}
I20260811 07:36:19.455279 12617 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37457
I20260811 07:36:19.455794 12617 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:19.457082 12617 heartbeater.cc:511] Master 127.22.4.254:37457 requested a full tablet report, sending...
I20260811 07:36:19.459620 11903 ts_manager.cc:194] Registered new tserver with Master: d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671)
I20260811 07:36:19.460476 11903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:59009
I20260811 07:36:19.467468 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:36:19.473881 12623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.468376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32826 (local address 127.22.4.254:37457)
0811 07:36:19.468672 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.468676 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.468701 (+ 25us) server_negotiation.cc:407] Connection header received
0811 07:36:19.468895 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.468899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.469060 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.469217 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:36:19.469635 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.470369 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.471543 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.471829 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.471954 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.472460 (+ 506us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:36:19.473256 (+ 796us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:36:19.473395 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.473534 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.473707 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
I20260811 07:36:19.475231 11903 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:32826:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:36:19.480696 11903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:36:19.494406 12077 tablet_service.cc:1467] Processing CreateTablet for tablet dd9a96a3a97442cf8637b632867717d8 (DEFAULT_TABLE table=test-table [id=2e402c55e69240ea8a92835a115090f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:19.495455 12077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd9a96a3a97442cf8637b632867717d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:19.499399 12630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.492618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:42161 (local address 127.0.0.1:38894)
0811 07:36:19.493569 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.493589 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:19.493752 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:19.494537 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:19.494541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:19.494560 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:19.494710 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.494722 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.496388 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.496395 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.497498 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.497510 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.498697 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.498704 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.498816 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.498951 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 07:36:19.499066 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:36:19.499196 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":853,"thread_start_us":176,"threads_started":1}
I20260811 07:36:19.500629 12629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.492869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:46671 (local address 127.0.0.1:54630)
0811 07:36:19.493988 (+ 1119us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.494002 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:19.494143 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:19.494935 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:19.494937 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:19.494957 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:19.495049 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.495055 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.496806 (+ 1751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.496810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.498193 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.498210 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.499992 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.499996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.500095 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.500139 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 07:36:19.500241 (+ 102us) client_negotiation.cc:240] Negotiation successful
0811 07:36:19.500338 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"thread_start_us":132,"threads_started":1}
I20260811 07:36:19.500627 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.493148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54630 (local address 127.22.4.195:46671)
0811 07:36:19.493630 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.493645 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.494178 (+ 533us) server_negotiation.cc:407] Connection header received
0811 07:36:19.494317 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.494324 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.494609 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.494857 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:19.495194 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.496599 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.498570 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.499823 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.499975 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.500169 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.500293 (+ 124us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.500432 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":138,"threads_started":1}
I20260811 07:36:19.501248 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.492864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38894 (local address 127.22.4.194:42161)
0811 07:36:19.493844 (+ 980us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.493859 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.493888 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:36:19.493993 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.494002 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.494325 (+ 323us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.494531 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:19.494933 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.496254 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.497638 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.498301 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.498673 (+ 372us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.498920 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.501004 (+ 2084us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.501124 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":864,"thread_start_us":280,"threads_started":1}
I20260811 07:36:19.501807 12634 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Bootstrap starting.
I20260811 07:36:19.503273 12634 tablet_bootstrap.cc:654] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:19.505216 12634 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: No bootstrap required, opened a new log
I20260811 07:36:19.505393 12634 ts_tablet_manager.cc:1397] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 07:36:19.505437 12508 tablet_service.cc:1467] Processing CreateTablet for tablet dd9a96a3a97442cf8637b632867717d8 (DEFAULT_TABLE table=test-table [id=2e402c55e69240ea8a92835a115090f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:19.506050 12634 raft_consensus.cc:348] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.506222 12634 raft_consensus.cc:374] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:19.506285 12634 raft_consensus.cc:729] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa00daf6eb6145c09099f2ae3e55d615, State: Initialized, Role: FOLLOWER
I20260811 07:36:19.505656 12302 tablet_service.cc:1467] Processing CreateTablet for tablet dd9a96a3a97442cf8637b632867717d8 (DEFAULT_TABLE table=test-table [id=2e402c55e69240ea8a92835a115090f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:19.506520 12634 consensus_queue.cc:260] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.506919 12508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd9a96a3a97442cf8637b632867717d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:19.507246 12302 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd9a96a3a97442cf8637b632867717d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:19.507064 12634 ts_tablet_manager.cc:1428] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 07:36:19.516018 12637 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: Bootstrap starting.
I20260811 07:36:19.518275 12640 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Bootstrap starting.
I20260811 07:36:19.519589 12637 tablet_bootstrap.cc:654] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:19.520658 12637 log.cc:824] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:19.521636 12640 tablet_bootstrap.cc:654] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:19.522785 12640 log.cc:824] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:19.524389 12637 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: No bootstrap required, opened a new log
I20260811 07:36:19.524649 12637 ts_tablet_manager.cc:1397] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.004s
I20260811 07:36:19.526618 12640 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: No bootstrap required, opened a new log
I20260811 07:36:19.527019 12640 ts_tablet_manager.cc:1397] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 07:36:19.528132 12637 raft_consensus.cc:348] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.528451 12637 raft_consensus.cc:374] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:19.528512 12637 raft_consensus.cc:729] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7c2901524e2487aa3a6a6e4e05a13af, State: Initialized, Role: FOLLOWER
I20260811 07:36:19.529059 12637 consensus_queue.cc:260] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.529870 12617 heartbeater.cc:503] Master 127.22.4.254:37457 was elected leader, sending a full tablet report...
I20260811 07:36:19.530411 12637 ts_tablet_manager.cc:1428] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260811 07:36:19.533226 12640 raft_consensus.cc:348] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.533537 12640 raft_consensus.cc:374] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:19.533619 12640 raft_consensus.cc:729] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f332a5c42903433a8b274157ed0b66cc, State: Initialized, Role: FOLLOWER
I20260811 07:36:19.534152 12640 consensus_queue.cc:260] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.535231 12405 heartbeater.cc:503] Master 127.22.4.254:37457 was elected leader, sending a full tablet report...
I20260811 07:36:19.535491 12640 ts_tablet_manager.cc:1428] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260811 07:36:19.584031 12202 tablet.cc:2369] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:19.586442 12649 raft_consensus.cc:482] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:19.586694 12649 raft_consensus.cc:504] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.588017 12649 leader_election.cc:288] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671), fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667)
I20260811 07:36:19.590937 12645 raft_consensus.cc:482] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:19.591171 12645 raft_consensus.cc:504] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.592674 12645 leader_election.cc:288] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161), fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667)
I20260811 07:36:19.594532 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.588623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:60303 (local address 127.22.4.195:46671)
0811 07:36:19.588777 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.588782 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.589242 (+ 460us) server_negotiation.cc:407] Connection header received
0811 07:36:19.589394 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.589397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.589464 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.589571 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:19.590142 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.591162 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.592854 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.593563 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.593702 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.593807 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.594171 (+ 364us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.594357 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:36:19.594754 12407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.588473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35667 (local address 127.22.4.194:34441)
0811 07:36:19.588837 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.588861 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:19.589007 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:19.589642 (+ 635us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:19.589646 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:19.589700 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:19.589951 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.589962 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.591304 (+ 1342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.591310 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.592646 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.592660 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.594182 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.594185 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.594338 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.594372 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 07:36:19.594463 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 07:36:19.594560 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":87,"spinlock_wait_cycles":12416}
I20260811 07:36:19.595144 12650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.588473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:46671 (local address 127.22.4.194:60303)
0811 07:36:19.589079 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.589096 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:19.589261 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:19.589642 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:19.589646 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:19.589699 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:19.590003 (+ 304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.590013 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.591370 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.591379 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.592655 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.592672 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.593843 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.593850 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.593976 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.594012 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:36:19.594799 (+ 787us) client_negotiation.cc:240] Negotiation successful
0811 07:36:19.594939 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"mutex_wait_us":200,"spinlock_wait_cycles":41856,"thread_start_us":163,"threads_started":1}
I20260811 07:36:19.595590 12651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.588697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:34441 (local address 127.22.4.193:35667)
0811 07:36:19.589116 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.589147 (+ 31us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.589163 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:36:19.589307 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.589311 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.589410 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.589572 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:19.590143 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.591159 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.592882 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.594025 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.595043 (+ 1018us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.595300 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.595349 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.595433 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":300,"thread_start_us":121,"threads_started":1}
I20260811 07:36:19.596029 12546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9a96a3a97442cf8637b632867717d8" candidate_uuid: "f332a5c42903433a8b274157ed0b66cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" is_pre_election: true
I20260811 07:36:19.596212 12116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9a96a3a97442cf8637b632867717d8" candidate_uuid: "f332a5c42903433a8b274157ed0b66cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa00daf6eb6145c09099f2ae3e55d615" is_pre_election: true
I20260811 07:36:19.596388 12546 raft_consensus.cc:2454] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f332a5c42903433a8b274157ed0b66cc in term 0.
I20260811 07:36:19.596642 12116 raft_consensus.cc:2454] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f332a5c42903433a8b274157ed0b66cc in term 0.
I20260811 07:36:19.597064 12237 leader_election.cc:302] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d7c2901524e2487aa3a6a6e4e05a13af, f332a5c42903433a8b274157ed0b66cc; no voters:
I20260811 07:36:19.597786 12649 raft_consensus.cc:2781] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:36:19.597908 12649 raft_consensus.cc:482] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:36:19.597962 12649 raft_consensus.cc:3037] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:19.598729 12622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.592986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:42161 (local address 127.22.4.195:55821)
0811 07:36:19.593163 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.593184 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:19.593302 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:19.594309 (+ 1007us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:19.594313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:19.594335 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:19.594488 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.594496 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.595742 (+ 1246us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.595746 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.596997 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.597009 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.598221 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.598225 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.598354 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.598394 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 07:36:19.598486 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 07:36:19.598577 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 07:36:19.598767 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.593786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:55821 (local address 127.22.4.194:42161)
0811 07:36:19.593932 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.593937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.593952 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:36:19.594003 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.594006 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.594061 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.594142 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:19.594624 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.595437 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.597373 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.598060 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.598211 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.598318 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.598536 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.598624 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:36:19.599925 12649 raft_consensus.cc:504] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.600543 12649 leader_election.cc:288] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [CANDIDATE]: Term 1 election: Requested vote from peers d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671), fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667)
I20260811 07:36:19.600835 12653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.593648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:34483 (local address 127.22.4.193:35667)
0811 07:36:19.594165 (+ 517us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.594178 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.595791 (+ 1613us) server_negotiation.cc:407] Connection header received
0811 07:36:19.595951 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.595955 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.596009 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.596085 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:19.596831 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.597611 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.599244 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.600024 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.600191 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.600258 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.600519 (+ 261us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.600642 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":155,"threads_started":1}
W20260811 07:36:19.600888 12406 tablet.cc:2369] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:19.601248 12333 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9a96a3a97442cf8637b632867717d8" candidate_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f332a5c42903433a8b274157ed0b66cc" is_pre_election: true
I20260811 07:36:19.601401 12652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.593364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35667 (local address 127.22.4.195:34483)
0811 07:36:19.595508 (+ 2144us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.595526 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:19.595818 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:19.596285 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:19.596289 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:19.596309 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:19.596628 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.596638 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.597730 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.597737 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.599066 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:19.599078 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.600223 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.600229 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:19.600340 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.600371 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:36:19.601130 (+ 759us) client_negotiation.cc:240] Negotiation successful
0811 07:36:19.601224 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1792,"thread_start_us":220,"threads_started":1}
I20260811 07:36:19.601660 12333 raft_consensus.cc:2379] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7c2901524e2487aa3a6a6e4e05a13af in current term 1: Already voted for candidate f332a5c42903433a8b274157ed0b66cc in this term.
I20260811 07:36:19.602316 12116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9a96a3a97442cf8637b632867717d8" candidate_uuid: "f332a5c42903433a8b274157ed0b66cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa00daf6eb6145c09099f2ae3e55d615"
I20260811 07:36:19.602538 12116 raft_consensus.cc:3037] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:19.602854 12546 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9a96a3a97442cf8637b632867717d8" candidate_uuid: "f332a5c42903433a8b274157ed0b66cc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7c2901524e2487aa3a6a6e4e05a13af"
I20260811 07:36:19.603062 12546 raft_consensus.cc:3037] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:19.603209 12113 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd9a96a3a97442cf8637b632867717d8" candidate_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa00daf6eb6145c09099f2ae3e55d615" is_pre_election: true
I20260811 07:36:19.604024 12437 leader_election.cc:302] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7c2901524e2487aa3a6a6e4e05a13af; no voters: f332a5c42903433a8b274157ed0b66cc, fa00daf6eb6145c09099f2ae3e55d615
I20260811 07:36:19.604458 12116 raft_consensus.cc:2454] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f332a5c42903433a8b274157ed0b66cc in term 1.
I20260811 07:36:19.604867 12546 raft_consensus.cc:2454] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f332a5c42903433a8b274157ed0b66cc in term 1.
I20260811 07:36:19.604872 12235 leader_election.cc:302] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f332a5c42903433a8b274157ed0b66cc, fa00daf6eb6145c09099f2ae3e55d615; no voters:
I20260811 07:36:19.605016 12645 raft_consensus.cc:2726] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 07:36:19.605116 12649 raft_consensus.cc:2781] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:19.605439 12649 raft_consensus.cc:686] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 1 LEADER]: Becoming Leader. State: Replica: f332a5c42903433a8b274157ed0b66cc, State: Running, Role: LEADER
I20260811 07:36:19.605913 12649 consensus_queue.cc:237] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:19.610491 11899 catalog_manager.cc:5495] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc reported cstate change: term changed from 0 to 1, leader changed from <none> to f332a5c42903433a8b274157ed0b66cc (127.22.4.194). New cstate: current_term: 1 leader_uuid: "f332a5c42903433a8b274157ed0b66cc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } health_report { overall_health: UNKNOWN } } }
I20260811 07:36:19.638811 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.634283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38898 (local address 127.22.4.194:42161)
0811 07:36:19.634437 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:19.634442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:19.634457 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:36:19.634575 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:19.634578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:19.634655 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:19.634774 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:36:19.635184 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.635886 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.636839 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:19.637113 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:19.637207 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:19.637647 (+ 440us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:36:19.638325 (+ 678us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:36:19.638446 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:19.638527 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 07:36:19.638594 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:36:19.647526 12116 raft_consensus.cc:1261] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Refusing update from remote peer f332a5c42903433a8b274157ed0b66cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:19.647939 12546 raft_consensus.cc:1261] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 1 FOLLOWER]: Refusing update from remote peer f332a5c42903433a8b274157ed0b66cc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:19.648520 12655 consensus_queue.cc:1035] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:19.648964 12649 consensus_queue.cc:1035] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:19.658357 12659 mvcc.cc:205] Tried to move back new op lower bound from 7317232761425174528 to 7317232761268957184. Current Snapshot: MvccSnapshot[applied={T|T < 7317232761425174528}]
I20260811 07:36:19.660712 12660 mvcc.cc:205] Tried to move back new op lower bound from 7317232761425174528 to 7317232761268957184. Current Snapshot: MvccSnapshot[applied={T|T < 7317232761425174528}]
I20260811 07:36:19.661037 12661 mvcc.cc:205] Tried to move back new op lower bound from 7317232761425174528 to 7317232761268957184. Current Snapshot: MvccSnapshot[applied={T|T < 7317232761425174528}]
I20260811 07:36:19.672525 11903 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:32826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:36:19.672757 11903 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:32826:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:36:19.676146 11903 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Sending DeleteTablet for 3 replicas of tablet dd9a96a3a97442cf8637b632867717d8
I20260811 07:36:19.677244 12508 tablet_service.cc:1514] Processing DeleteTablet for tablet dd9a96a3a97442cf8637b632867717d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:19 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:54630
I20260811 07:36:19.677258 12077 tablet_service.cc:1514] Processing DeleteTablet for tablet dd9a96a3a97442cf8637b632867717d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:19 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:57776
I20260811 07:36:19.677467 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 11961
I20260811 07:36:19.684209 12302 tablet_service.cc:1514] Processing DeleteTablet for tablet dd9a96a3a97442cf8637b632867717d8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:19 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:38894
I20260811 07:36:19.687300 12672 tablet_replica.cc:330] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: stopping tablet replica
I20260811 07:36:19.687520 12674 tablet_replica.cc:330] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: stopping tablet replica
I20260811 07:36:19.687842 12674 raft_consensus.cc:2229] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:36:19.687844 12672 raft_consensus.cc:2229] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:36:19.688434 12672 raft_consensus.cc:2258] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:19.688977 12674 raft_consensus.cc:2258] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:19.690965 12674 ts_tablet_manager.cc:1905] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:19.690927 12672 ts_tablet_manager.cc:1905] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:19.694978 12674 ts_tablet_manager.cc:1918] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:19.695299 12674 log.cc:1196] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/dd9a96a3a97442cf8637b632867717d8
I20260811 07:36:19.695302 12672 ts_tablet_manager.cc:1918] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:19.695448 12672 log.cc:1196] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/dd9a96a3a97442cf8637b632867717d8
I20260811 07:36:19.695917 12672 ts_tablet_manager.cc:1939] T dd9a96a3a97442cf8637b632867717d8 P d7c2901524e2487aa3a6a6e4e05a13af: Deleting consensus metadata
I20260811 07:36:19.695917 12674 ts_tablet_manager.cc:1939] T dd9a96a3a97442cf8637b632867717d8 P f332a5c42903433a8b274157ed0b66cc: Deleting consensus metadata
I20260811 07:36:19.697517 11881 catalog_manager.cc:4841] TS f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161): tablet dd9a96a3a97442cf8637b632867717d8 (table test-table [id=2e402c55e69240ea8a92835a115090f3]) successfully deleted
I20260811 07:36:19.697517 11884 catalog_manager.cc:4841] TS d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671): tablet dd9a96a3a97442cf8637b632867717d8 (table test-table [id=2e402c55e69240ea8a92835a115090f3]) successfully deleted
W20260811 07:36:19.700651 11881 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:35667 (error 108)
I20260811 07:36:19.701735 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 12206
I20260811 07:36:19.718614 12629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:19.702053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:35667 (local address 127.0.0.1:57782)
0811 07:36:19.710405 (+ 8352us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:19.718437 (+ 8032us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:35667: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8116}
W20260811 07:36:19.719286 11881 catalog_manager.cc:4584] TS fa00daf6eb6145c09099f2ae3e55d615 (127.22.4.193:35667): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dd9a96a3a97442cf8637b632867717d8: Network error: Client connection negotiation failed: client connection to 127.22.4.193:35667: connect: Connection refused (error 111)
I20260811 07:36:19.730384 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 12410
I20260811 07:36:19.751998 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 11857
I20260811 07:36:19.780740 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37457
--webserver_interface=127.22.4.254
--webserver_port=43931
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:37457
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:19.924721 12676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:19.925127 12676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:19.925205 12676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:19.929646 12676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:19.929767 12676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:19.929806 12676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:19.929848 12676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:19.929900 12676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:19.936071 12676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:37457
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=43931
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:19.937453 12676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:19.938715 12676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:36:19.950697 12676 server_base.cc:1034] running on GCE node
W20260811 07:36:19.950567 12687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:19.950752 12685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:19.950580 12684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:19.951952 12676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:19.953437 12676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:19.954922 12676 hybrid_clock.cc:648] HybridClock initialized: now 1786433779954882 us; error 61 us; skew 500 ppm
Aug 11 07:36:19 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433779, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:19.958950 12676 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:19.960217 12676 webserver.cc:460] Webserver started at http://127.22.4.254:43931/ using document root <none> and password file <none>
I20260811 07:36:19.960985 12676 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:19.961097 12676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:19.966603 12676 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:36:19.970266 12695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:19.972826 12676 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:36:19.973102 12676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b40f7b6069764d9a8ed743dfe8929f78"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "42b671569be32f90cd7eef31bcfcca87"
server_key_iv: "b692e6e863bfd3c1a41df35515f2a60e"
server_key_version: "encryptionkey@0"
I20260811 07:36:19.974116 12676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:19.991948 12676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:19.997335 12676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:19.997613 12676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:20.010738 12676 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:37457
I20260811 07:36:20.011042 12776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:37457 every 8 connection(s)
I20260811 07:36:20.012691 12676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:20.020244 12777 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:36:20.022678 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 12676
I20260811 07:36:20.023231 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:35667
--local_ip_for_outbound_sockets=127.22.4.193
--tserver_master_addrs=127.22.4.254:37457
--webserver_port=34777
--webserver_interface=127.22.4.193
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:36:20.023411 12777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Bootstrap starting.
I20260811 07:36:20.059423 12777 log.cc:824] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:20.079638 12777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:36:20.080397 12777 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78: Bootstrap complete.
I20260811 07:36:20.089232 12777 raft_consensus.cc:348] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:20.090059 12777 raft_consensus.cc:729] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b40f7b6069764d9a8ed743dfe8929f78, State: Initialized, Role: FOLLOWER
I20260811 07:36:20.090934 12777 consensus_queue.cc:260] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:20.091176 12777 raft_consensus.cc:388] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:36:20.091257 12777 raft_consensus.cc:482] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:36:20.091398 12777 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:36:20.095285 12777 raft_consensus.cc:504] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:20.095884 12777 leader_election.cc:302] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b40f7b6069764d9a8ed743dfe8929f78; no voters:
I20260811 07:36:20.096395 12777 leader_election.cc:288] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 07:36:20.096740 12781 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:36:20.097232 12781 raft_consensus.cc:686] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [term 3 LEADER]: Becoming Leader. State: Replica: b40f7b6069764d9a8ed743dfe8929f78, State: Running, Role: LEADER
I20260811 07:36:20.097818 12781 consensus_queue.cc:237] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } }
I20260811 07:36:20.098268 12777 sys_catalog.cc:564] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:20.100069 12783 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b40f7b6069764d9a8ed743dfe8929f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } } }
I20260811 07:36:20.100293 12783 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:20.100068 12784 sys_catalog.cc:455] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b40f7b6069764d9a8ed743dfe8929f78. Latest consensus state: current_term: 3 leader_uuid: "b40f7b6069764d9a8ed743dfe8929f78" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b40f7b6069764d9a8ed743dfe8929f78" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37457 } } }
I20260811 07:36:20.100454 12784 sys_catalog.cc:458] T 00000000000000000000000000000000 P b40f7b6069764d9a8ed743dfe8929f78 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:20.100844 12797 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:20.108328 12797 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:20.109258 12797 catalog_manager.cc:1259] Loaded cluster ID: 719b01db4b3f4a4c8e7b0646d485b52c
I20260811 07:36:20.109352 12797 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 07:36:20.110678 12797 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f826d4739ad google::LogMessage::Fail() at ??:0
@ 0x7f826d47688a google::LogMessage::SendToLog() at ??:0
@ 0x7f826d4734de google::LogMessage::Flush() at ??:0
@ 0x7f826d474a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8277db2fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f8277db3d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8277db0579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f8277df4640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f826f6c53d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f826f6c5c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f826f6c73f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f826f6b6512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8270cfa6db start_thread at ??:0
@ 0x7f826bf7161f clone at ??:0
W20260811 07:36:20.220669 12779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:20.221069 12779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:20.221160 12779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:20.225759 12779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:20.225893 12779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:20.225996 12779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:36:20.232434 12779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:35667
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=34777
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:20.233829 12779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:20.235450 12779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:20.248816 12841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:20.248960 12779 server_base.cc:1034] running on GCE node
W20260811 07:36:20.249224 12842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:20.248795 12845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:20.250077 12779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:20.251535 12779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:20.252820 12779 hybrid_clock.cc:648] HybridClock initialized: now 1786433780252779 us; error 57 us; skew 500 ppm
Aug 11 07:36:20 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433780, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:20.257790 12779 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:36:20.259187 12779 webserver.cc:460] Webserver started at http://127.22.4.193:34777/ using document root <none> and password file <none>
I20260811 07:36:20.259845 12779 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:20.259920 12779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:20.265550 12779 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:36:20.268875 12852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:20.270763 12779 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 07:36:20.271032 12779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "fa00daf6eb6145c09099f2ae3e55d615"
format_stamp: "Formatted at 2026-08-11 07:36:16 on dist-test-slave-7z32"
server_key: "3d1266209b34b74862086f96de3d55d8"
server_key_iv: "e7376aaea8be4167448b751c141580e8"
server_key_version: "encryptionkey@0"
I20260811 07:36:20.271760 12779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:20.285805 12779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:20.290767 12779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:20.291066 12779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:20.291791 12779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:20.293239 12859 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:36:20.301358 12779 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:36:20.301554 12779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.009s user 0.000s sys 0.001s
I20260811 07:36:20.301672 12779 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:36:20.305136 12779 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:36:20.305485 12779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.002s sys 0.000s
I20260811 07:36:20.306036 12859 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Bootstrap starting.
I20260811 07:36:20.320855 12779 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:35667
I20260811 07:36:20.321141 13014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:35667 every 8 connection(s)
I20260811 07:36:20.322122 12779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:36:20.330420 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 12779
I20260811 07:36:20.331738 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:42161
--local_ip_for_outbound_sockets=127.22.4.194
--tserver_master_addrs=127.22.4.254:37457
--webserver_port=37235
--webserver_interface=127.22.4.194
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:36:20.344241 12859 log.cc:824] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:20.359616 12859 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:36:20.360472 12859 tablet_bootstrap.cc:492] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Bootstrap complete.
I20260811 07:36:20.362861 12859 ts_tablet_manager.cc:1397] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Time spent bootstrapping tablet: real 0.057s user 0.045s sys 0.007s
I20260811 07:36:20.367730 12859 raft_consensus.cc:348] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:20.368619 12859 raft_consensus.cc:729] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa00daf6eb6145c09099f2ae3e55d615, State: Initialized, Role: FOLLOWER
I20260811 07:36:20.369650 12859 consensus_queue.cc:260] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:20.371281 12859 ts_tablet_manager.cc:1428] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
W20260811 07:36:20.432338 13019 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:36:20.324642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:38495)
0811 07:36:20.325244 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.325304 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:20.326300 (+ 996us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:20.431269 (+104969us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":190,"threads_started":1}
W20260811 07:36:20.433010 13015 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:37457 (0 consecutive failures): Network error: Failed to ping master at 127.22.4.254:37457: Client connection negotiation failed: client connection to 127.22.4.254:37457: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 07:36:20.433903 13019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:20.433607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:37965)
0811 07:36:20.433748 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.433842 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260811 07:36:20.434576 13019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:20.434358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:36815)
0811 07:36:20.434471 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.434525 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 07:36:20.434748 13015 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:36:20.510741 13020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:20.511277 13020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:20.511373 13020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:20.516069 13020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:20.516218 13020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:20.516340 13020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:36:20.523351 13020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:42161
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=37235
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:20.525173 13020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:20.526796 13020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:20.543210 13032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:20.543210 13035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:20.543911 13033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:20.543269 13020 server_base.cc:1034] running on GCE node
I20260811 07:36:20.544715 13020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:20.545658 13020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:20.549252 13020 hybrid_clock.cc:648] HybridClock initialized: now 1786433780549147 us; error 115 us; skew 500 ppm
Aug 11 07:36:20 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433780, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:20.553791 13020 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:36:20.555513 13020 webserver.cc:460] Webserver started at http://127.22.4.194:37235/ using document root <none> and password file <none>
I20260811 07:36:20.556353 13020 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:20.556447 13020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:20.563179 13020 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.004s
I20260811 07:36:20.566717 13046 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:20.569792 13020 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:36:20.570011 13020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "f332a5c42903433a8b274157ed0b66cc"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "efa6bdd303ff69d89605c1e758ca0876"
server_key_iv: "fc2abe6c0faec9622f2adbfba3c3a363"
server_key_version: "encryptionkey@0"
I20260811 07:36:20.570963 13020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:20.593209 13020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:20.598728 13020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:20.599421 13020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:20.600400 13020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:20.601549 13020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:20.601613 13020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:20.601660 13020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:20.601676 13020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:20.619719 13020 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:42161
I20260811 07:36:20.619850 13212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:42161 every 8 connection(s)
I20260811 07:36:20.621186 13020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:36:20.628054 13217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:20.625268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:52121)
0811 07:36:20.626339 (+ 1071us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.627052 (+ 713us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":232,"threads_started":1}
W20260811 07:36:20.629274 13215 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:37457 (0 consecutive failures): Network error: Failed to ping master at 127.22.4.254:37457: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
I20260811 07:36:20.630656 13217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:20.630096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:37343)
0811 07:36:20.630474 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.630564 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":251}
I20260811 07:36:20.630744 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 13020
I20260811 07:36:20.631481 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:46671
--local_ip_for_outbound_sockets=127.22.4.195
--tserver_master_addrs=127.22.4.254:37457
--webserver_port=46207
--webserver_interface=127.22.4.195
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:36:20.632158 13217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:20.631716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:45737)
0811 07:36:20.631926 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.632018 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 07:36:20.632557 13215 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:36:20.783658 13218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:20.784241 13218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:20.784350 13218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:20.789779 13218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:20.789933 13218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:20.790050 13218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:36:20.798483 13218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:46671
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=46207
--tserver_master_addrs=127.22.4.254:37457
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:20.799997 13218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:20.802021 13218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:20.815593 13231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:20.815812 13229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:20.815593 13228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:20.816485 13218 server_base.cc:1034] running on GCE node
I20260811 07:36:20.817303 13218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:20.818684 13218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:20.822162 13218 hybrid_clock.cc:648] HybridClock initialized: now 1786433780822081 us; error 84 us; skew 500 ppm
Aug 11 07:36:20 dist-test-slave-7z32 krb5kdc[11002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433780, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:20.827651 13218 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:36:20.829267 13218 webserver.cc:460] Webserver started at http://127.22.4.195:46207/ using document root <none> and password file <none>
I20260811 07:36:20.830180 13218 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:20.830291 13218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:20.836938 13218 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.000s sys 0.004s
I20260811 07:36:20.840682 13244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:20.842938 13218 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:36:20.843204 13218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "d7c2901524e2487aa3a6a6e4e05a13af"
format_stamp: "Formatted at 2026-08-11 07:36:17 on dist-test-slave-7z32"
server_key: "25c6a3237890070761e841a8221b034a"
server_key_iv: "16113e7ef6e4ce196c263095d3843eb3"
server_key_version: "encryptionkey@0"
I20260811 07:36:20.844256 13218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:20.873382 13218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:20.880544 13218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:20.881234 13218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:20.882571 13218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:20.884414 13218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:20.884531 13218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:20.884625 13218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:20.884672 13218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:20.902462 13218 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:46671
I20260811 07:36:20.902508 13411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:46671 every 8 connection(s)
I20260811 07:36:20.904457 13218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:36:20.906363 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 13218
I20260811 07:36:20.910229 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:20.908047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:36533)
0811 07:36:20.908806 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.909414 (+ 608us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":165,"threads_started":1}
W20260811 07:36:20.911125 13412 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:37457 (0 consecutive failures): Network error: Failed to ping master at 127.22.4.254:37457: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
I20260811 07:36:20.912074 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:20.911767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:51981)
0811 07:36:20.911918 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.911989 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 07:36:20.913098 13416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:20.912824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:47619)
0811 07:36:20.912972 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:20.913029 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260811 07:36:20.913421 13412 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:36:21.436703 13417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:21.435799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:57759)
0811 07:36:21.436350 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:21.436538 (+ 188us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":136,"threads_started":1}
I20260811 07:36:21.634229 13420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:21.633506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:43475)
0811 07:36:21.633952 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:21.634069 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":127,"threads_started":1}
I20260811 07:36:21.711879 13421 raft_consensus.cc:482] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:21.712603 13421 raft_consensus.cc:504] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:21.714737 13421 leader_election.cc:288] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161), d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671)
Aug 11 07:36:21 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433780, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.195@KRBTEST.COM
Aug 11 07:36:21 dist-test-slave-7z32 krb5kdc[11002](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433780, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.194@KRBTEST.COM
I20260811 07:36:21.739358 13417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:21.715286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:42161 (local address 127.22.4.193:53033)
0811 07:36:21.715472 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:21.715496 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:21.715645 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:21.718604 (+ 2959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:21.718613 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:21.719554 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:21.720374 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:21.720399 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:21.724738 (+ 4339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:21.724743 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:21.725790 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:21.725811 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:21.726804 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:21.726808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:21.727098 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:21.728102 (+ 1004us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:21.728122 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:21.731078 (+ 2956us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:21.734532 (+ 3454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:21.734541 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:21.734565 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:21.735049 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:21.735994 (+ 945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:21.735997 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:21.736000 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:21.736306 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:21.737664 (+ 1358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:21.737674 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:21.738102 (+ 428us) client_negotiation.cc:769] Sending connection context
0811 07:36:21.738385 (+ 283us) client_negotiation.cc:240] Negotiation successful
0811 07:36:21.739088 (+ 703us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":58,"spinlock_wait_cycles":10240}
I20260811 07:36:21.739382 13422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:21.715561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:53033 (local address 127.22.4.194:42161)
0811 07:36:21.716146 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:21.716191 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:21.716247 (+ 56us) server_negotiation.cc:407] Connection header received
0811 07:36:21.717421 (+ 1174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:21.717430 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:21.717915 (+ 485us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:21.718317 (+ 402us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:21.721017 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:21.724425 (+ 3408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:21.726028 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:21.726613 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:21.726798 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:21.731493 (+ 4695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:21.731501 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:21.731523 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:21.731569 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:21.734210 (+ 2641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:21.735226 (+ 1016us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:21.735233 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:21.735238 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:21.735815 (+ 577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:21.736493 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:21.736497 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:21.736499 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:21.737485 (+ 986us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:21.737716 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:21.738586 (+ 870us) server_negotiation.cc:299] Negotiation successful
0811 07:36:21.739070 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":109,"threads_started":1}
I20260811 07:36:21.739368 13425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:21.715573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:39661 (local address 127.22.4.195:46671)
0811 07:36:21.716072 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:21.716102 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:21.716435 (+ 333us) server_negotiation.cc:407] Connection header received
0811 07:36:21.717600 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:21.717608 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:21.718133 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:21.718697 (+ 564us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:21.721479 (+ 2782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:21.723369 (+ 1890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:21.726002 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:21.726776 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:21.727098 (+ 322us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:21.731258 (+ 4160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:21.731267 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:21.731288 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:21.731340 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:21.734559 (+ 3219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:21.735937 (+ 1378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:21.735950 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:21.735961 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:21.736248 (+ 287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:21.736811 (+ 563us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:21.736837 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:21.736843 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:21.737687 (+ 844us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:21.737892 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:21.738582 (+ 690us) server_negotiation.cc:299] Negotiation successful
0811 07:36:21.739098 (+ 516us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":283,"thread_start_us":111,"threads_started":1}
I20260811 07:36:21.739478 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:21.715286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:46671 (local address 127.22.4.193:39661)
0811 07:36:21.716147 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:21.716168 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:21.716513 (+ 345us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:21.718903 (+ 2390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:21.718907 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:21.719527 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:21.721111 (+ 1584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:21.721127 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:21.723717 (+ 2590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:21.723724 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:21.725763 (+ 2039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:21.725786 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:21.727049 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:21.727056 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:21.727158 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:21.728082 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:21.728106 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:21.730771 (+ 2665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:21.735155 (+ 4384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:21.735280 (+ 125us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:21.735283 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:21.735619 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:21.736461 (+ 842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:21.736466 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:21.736468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:21.736633 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:21.737865 (+ 1232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:21.737870 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:21.738104 (+ 234us) client_negotiation.cc:769] Sending connection context
0811 07:36:21.738386 (+ 282us) client_negotiation.cc:240] Negotiation successful
0811 07:36:21.739224 (+ 838us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"mutex_wait_us":2156,"thread_start_us":140,"threads_started":1}
W20260811 07:36:21.744990 12853 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
W20260811 07:36:21.745879 12855 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
I20260811 07:36:21.746002 12855 leader_election.cc:302] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa00daf6eb6145c09099f2ae3e55d615; no voters: d7c2901524e2487aa3a6a6e4e05a13af, f332a5c42903433a8b274157ed0b66cc
I20260811 07:36:21.746430 13421 raft_consensus.cc:2726] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:36:21.915427 13429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:21.914598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:44037)
0811 07:36:21.915164 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:21.915255 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":104,"threads_started":1}
I20260811 07:36:22.438678 13441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:22.438013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:39113)
0811 07:36:22.438467 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:22.438560 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":320,"thread_start_us":130,"threads_started":1}
I20260811 07:36:22.636224 13442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:22.635523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:46651)
0811 07:36:22.635979 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:22.636067 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":118,"threads_started":1}
I20260811 07:36:22.917546 13443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:22.916805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:45255)
0811 07:36:22.917229 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:22.917346 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":294,"thread_start_us":107,"threads_started":1}
I20260811 07:36:23.264002 13444 raft_consensus.cc:482] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:23.264206 13444 raft_consensus.cc:504] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:23.264780 13444 leader_election.cc:288] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161), d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671)
W20260811 07:36:23.266098 12855 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
W20260811 07:36:23.266228 12853 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
I20260811 07:36:23.266314 12853 leader_election.cc:302] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa00daf6eb6145c09099f2ae3e55d615; no voters: d7c2901524e2487aa3a6a6e4e05a13af, f332a5c42903433a8b274157ed0b66cc
I20260811 07:36:23.266569 13444 raft_consensus.cc:2726] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:36:23.440567 13445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:23.439863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:49245)
0811 07:36:23.440329 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:23.440424 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":130,"threads_started":1}
I20260811 07:36:23.638284 13446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:23.637547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:60347)
0811 07:36:23.638055 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:23.638125 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":234,"threads_started":1}
I20260811 07:36:23.919976 13447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:23.919305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:51805)
0811 07:36:23.919702 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:23.919794 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":124,"threads_started":1}
I20260811 07:36:24.442572 13448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:24.441889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:55433)
0811 07:36:24.442328 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:24.442423 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":110,"threads_started":1}
I20260811 07:36:24.640272 13452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:24.639455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:46241)
0811 07:36:24.639992 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:24.640094 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":105,"threads_started":1}
I20260811 07:36:24.921905 13453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:24.921167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:52561)
0811 07:36:24.921636 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:24.921749 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":103,"threads_started":1}
I20260811 07:36:25.445013 13454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:25.444343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:37301)
0811 07:36:25.444795 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:25.444873 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":177,"threads_started":1}
I20260811 07:36:25.642576 13455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:25.641789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:39397)
0811 07:36:25.642300 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:25.642409 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":110,"threads_started":1}
I20260811 07:36:25.924824 13456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:25.923862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:50837)
0811 07:36:25.924581 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:25.924680 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":545,"thread_start_us":306,"threads_started":1}
I20260811 07:36:26.412307 13457 raft_consensus.cc:482] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:26.412508 13457 raft_consensus.cc:504] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:26.413118 13457 leader_election.cc:288] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161), d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671)
W20260811 07:36:26.414222 12855 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
W20260811 07:36:26.414536 12853 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
I20260811 07:36:26.414707 12853 leader_election.cc:302] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa00daf6eb6145c09099f2ae3e55d615; no voters: d7c2901524e2487aa3a6a6e4e05a13af, f332a5c42903433a8b274157ed0b66cc
I20260811 07:36:26.414995 13457 raft_consensus.cc:2726] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:36:26.447329 13459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:26.446598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:46355)
0811 07:36:26.447083 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:26.447155 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":102,"threads_started":1}
I20260811 07:36:26.644773 13460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:26.644028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:53453)
0811 07:36:26.644548 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:26.644646 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":121,"threads_started":1}
I20260811 07:36:26.926708 13461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:26.925962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:54419)
0811 07:36:26.926447 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:26.926560 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":100,"threads_started":1}
I20260811 07:36:27.449373 13462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:27.448613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:41039)
0811 07:36:27.449144 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:27.449246 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":248,"threads_started":1}
I20260811 07:36:27.647099 13463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:27.646156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:58479)
0811 07:36:27.646720 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:27.646810 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":109,"threads_started":1}
I20260811 07:36:27.928767 13464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:27.928028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:35567)
0811 07:36:27.928489 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:27.928574 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":99,"threads_started":1}
I20260811 07:36:28.360216 13465 raft_consensus.cc:482] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:28.360436 13465 raft_consensus.cc:504] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:28.361111 13465 leader_election.cc:288] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161), d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671)
W20260811 07:36:28.362505 12853 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
W20260811 07:36:28.362892 12855 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
I20260811 07:36:28.362968 12855 leader_election.cc:302] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa00daf6eb6145c09099f2ae3e55d615; no voters: d7c2901524e2487aa3a6a6e4e05a13af, f332a5c42903433a8b274157ed0b66cc
I20260811 07:36:28.363145 13465 raft_consensus.cc:2726] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:36:28.451294 13466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:28.450580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:46565)
0811 07:36:28.451000 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:28.451101 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":155,"threads_started":1}
I20260811 07:36:28.649104 13467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:28.648320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:52391)
0811 07:36:28.648882 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:28.648966 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":191,"threads_started":1}
I20260811 07:36:28.930768 13468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:28.930020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:39593)
0811 07:36:28.930465 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:28.930562 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":101,"threads_started":1}
I20260811 07:36:29.453624 13469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:29.452770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:54405)
0811 07:36:29.453235 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:29.453502 (+ 267us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":122,"threads_started":1}
I20260811 07:36:29.651407 13471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:29.650541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:57217)
0811 07:36:29.651172 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:29.651268 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":116,"threads_started":1}
I20260811 07:36:29.933049 13472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:29.932181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:55569)
0811 07:36:29.932736 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:29.932861 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":105,"threads_started":1}
I20260811 07:36:30.456036 13474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:30.455367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:58889)
0811 07:36:30.455814 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:30.455891 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":110,"threads_started":1}
I20260811 07:36:30.653266 13476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:30.652773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:49521)
0811 07:36:30.653096 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:30.653163 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":118,"threads_started":1}
I20260811 07:36:30.935037 13477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:30.934343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:32969)
0811 07:36:30.934739 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:30.934896 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":127,"threads_started":1}
I20260811 07:36:31.457782 13478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:31.457147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:59523)
0811 07:36:31.457575 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:31.457663 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":142,"threads_started":1}
I20260811 07:36:31.655318 13479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:31.654391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:47155)
0811 07:36:31.655041 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:31.655164 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":108,"threads_started":1}
I20260811 07:36:31.937304 13480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:31.936383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:34001)
0811 07:36:31.936943 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:31.937055 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":124,"threads_started":1}
I20260811 07:36:32.459784 13481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:32.459077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:57707)
0811 07:36:32.459561 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:32.459649 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":160,"threads_started":1}
I20260811 07:36:32.657507 13484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:32.656752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:35013)
0811 07:36:32.657220 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:32.657375 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":127,"threads_started":1}
I20260811 07:36:32.939615 13488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:32.938920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:35823)
0811 07:36:32.939366 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:32.939465 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":104,"threads_started":1}
I20260811 07:36:33.462118 13489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:33.461273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:54255)
0811 07:36:33.461854 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:33.461955 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":126,"threads_started":1}
I20260811 07:36:33.659552 13490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:33.658794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:40985)
0811 07:36:33.659301 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:33.659402 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":151,"threads_started":1}
I20260811 07:36:33.941746 13491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:33.941112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:45191)
0811 07:36:33.941530 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:33.941616 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":125,"threads_started":1}
I20260811 07:36:34.464298 13492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:34.463703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:36443)
0811 07:36:34.464114 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:34.464183 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":184,"threads_started":1}
I20260811 07:36:34.661638 13494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:34.660884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:59207)
0811 07:36:34.661377 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:34.661490 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":361,"thread_start_us":112,"threads_started":1}
I20260811 07:36:34.869554 13495 raft_consensus.cc:482] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:34.869728 13495 raft_consensus.cc:504] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f332a5c42903433a8b274157ed0b66cc" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 42161 } } peers { permanent_uuid: "d7c2901524e2487aa3a6a6e4e05a13af" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46671 } } peers { permanent_uuid: "fa00daf6eb6145c09099f2ae3e55d615" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 35667 } }
I20260811 07:36:34.870419 13495 leader_election.cc:288] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161), d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671)
W20260811 07:36:34.871548 12853 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f332a5c42903433a8b274157ed0b66cc (127.22.4.194:42161): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
W20260811 07:36:34.871714 12855 leader_election.cc:341] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer d7c2901524e2487aa3a6a6e4e05a13af (127.22.4.195:46671): Not found: Tablet not found: dd9a96a3a97442cf8637b632867717d8
I20260811 07:36:34.871855 12855 leader_election.cc:302] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa00daf6eb6145c09099f2ae3e55d615; no voters: d7c2901524e2487aa3a6a6e4e05a13af, f332a5c42903433a8b274157ed0b66cc
I20260811 07:36:34.872072 13495 raft_consensus.cc:2726] T dd9a96a3a97442cf8637b632867717d8 P fa00daf6eb6145c09099f2ae3e55d615 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:36:34.943791 13497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:34.943090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:60537)
0811 07:36:34.943579 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:34.943668 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":180,"threads_started":1}
I20260811 07:36:35.466612 13498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:35.465989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.193:58765)
0811 07:36:35.466391 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:35.466475 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":110,"threads_started":1}
I20260811 07:36:35.663924 13499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:35.663224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.194:58129)
0811 07:36:35.663694 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:35.663796 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":136,"threads_started":1}
I20260811 07:36:35.917209 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 12779
I20260811 07:36:35.945977 13502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:35.945330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37457 (local address 127.22.4.195:59757)
0811 07:36:35.945741 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:35.945832 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:37457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":117,"threads_started":1}
I20260811 07:36:35.950805 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 13020
I20260811 07:36:35.990540 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 13218
2026-08-11T07:36:36Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (21296 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:36:36 dist-test-slave-7z32 krb5kdc[13506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:36:36 dist-test-slave-7z32 krb5kdc[13506](info): set up 2 sockets
Aug 11 07:36:36 dist-test-slave-7z32 krb5kdc[13506](info): commencing operation
krb5kdc: starting...
W20260811 07:36:37.418938 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.378s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:36:37 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:36:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:36:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:36:37.604070 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34955
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:37.745064 13529 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:37.745409 13529 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:37.745457 13529 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:37.749974 13529 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:36:37.750072 13529 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:36:37.750088 13529 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:36:37.750103 13529 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:37.750125 13529 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:37.750145 13529 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:37.750162 13529 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:37.750180 13529 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:37.756340 13529 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13529
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:37.757642 13529 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:37.758940 13529 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:37.771081 13543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:37.771178 13546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:37.771178 13544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:37.771270 13529 server_base.cc:1034] running on GCE node
I20260811 07:36:37.772614 13529 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:37.774555 13529 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:37.778106 13529 hybrid_clock.cc:648] HybridClock initialized: now 1786433797777980 us; error 103 us; skew 500 ppm
Aug 11 07:36:37 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433797, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:37.782574 13529 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:37.784351 13529 webserver.cc:460] Webserver started at http://127.22.4.254:37983/ using document root <none> and password file <none>
I20260811 07:36:37.785269 13529 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:37.785363 13529 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:37.785686 13529 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:37.788923 13529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "641d1dc29e46470591b9fa67bae8dc07"
format_stamp: "Formatted at 2026-08-11 07:36:37 on dist-test-slave-7z32"
server_key: "519c361d54fc88c0273a0b29d8970c6e"
server_key_iv: "c872d967db1b752fd0f2e4ff2d87efa7"
server_key_version: "encryptionkey@0"
I20260811 07:36:37.789801 13529 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "641d1dc29e46470591b9fa67bae8dc07"
format_stamp: "Formatted at 2026-08-11 07:36:37 on dist-test-slave-7z32"
server_key: "519c361d54fc88c0273a0b29d8970c6e"
server_key_iv: "c872d967db1b752fd0f2e4ff2d87efa7"
server_key_version: "encryptionkey@0"
I20260811 07:36:37.796303 13529 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260811 07:36:37.801885 13556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:37.804486 13529 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 07:36:37.804814 13529 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "641d1dc29e46470591b9fa67bae8dc07"
format_stamp: "Formatted at 2026-08-11 07:36:37 on dist-test-slave-7z32"
server_key: "519c361d54fc88c0273a0b29d8970c6e"
server_key_iv: "c872d967db1b752fd0f2e4ff2d87efa7"
server_key_version: "encryptionkey@0"
I20260811 07:36:37.805023 13529 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:37.824371 13529 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:37.829525 13529 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:37.829874 13529 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:37.841048 13529 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:34955
I20260811 07:36:37.841463 13640 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:34955 every 8 connection(s)
I20260811 07:36:37.842669 13529 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:37.846489 13641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:37.848253 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 13529
I20260811 07:36:37.848464 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:36:37.848876 22547 external_mini_cluster.cc:1428] Setting key 7bb61c377ed6a2ea0d102103f2bd2644
I20260811 07:36:37.853694 13641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Bootstrap starting.
I20260811 07:36:37.857012 13641 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:37.858043 13641 log.cc:824] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:37.861236 13641 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: No bootstrap required, opened a new log
Aug 11 07:36:37 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433797, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:37.864830 13641 raft_consensus.cc:348] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:36:37.865150 13641 raft_consensus.cc:374] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:37.865200 13641 raft_consensus.cc:729] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641d1dc29e46470591b9fa67bae8dc07, State: Initialized, Role: FOLLOWER
I20260811 07:36:37.865744 13641 consensus_queue.cc:260] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:36:37.865936 13641 raft_consensus.cc:388] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:36:37.866044 13641 raft_consensus.cc:482] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:36:37.866181 13641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:37.867457 13641 raft_consensus.cc:504] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:36:37.867880 13641 leader_election.cc:302] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 641d1dc29e46470591b9fa67bae8dc07; no voters:
I20260811 07:36:37.868340 13641 leader_election.cc:288] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:36:37.868438 13649 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:37.868736 13649 raft_consensus.cc:686] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 1 LEADER]: Becoming Leader. State: Replica: 641d1dc29e46470591b9fa67bae8dc07, State: Running, Role: LEADER
I20260811 07:36:37.869167 13649 consensus_queue.cc:237] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:36:37.870144 13641 sys_catalog.cc:564] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:37.870962 13649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "641d1dc29e46470591b9fa67bae8dc07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } } }
I20260811 07:36:37.871120 13649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:37.871572 13653 sys_catalog.cc:455] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 641d1dc29e46470591b9fa67bae8dc07. Latest consensus state: current_term: 1 leader_uuid: "641d1dc29e46470591b9fa67bae8dc07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } } }
I20260811 07:36:37.871730 13658 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:37.871767 13653 sys_catalog.cc:458] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:37.871822 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:37.851121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47008 (local address 127.22.4.254:34955)
0811 07:36:37.851791 (+ 670us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:37.851813 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:37.851867 (+ 54us) server_negotiation.cc:407] Connection header received
0811 07:36:37.852787 (+ 920us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:37.852813 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:37.853291 (+ 478us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:37.853685 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:37.854899 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:37.856325 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:37.857716 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:37.858436 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:37.858645 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:37.862142 (+ 3497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:37.862149 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:37.862173 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:37.862217 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:37.865681 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:37.866540 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:37.866548 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:37.866555 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:37.866735 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:37.867153 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:37.867172 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:37.867173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:37.867914 (+ 741us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:37.868251 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:37.869556 (+ 1305us) server_negotiation.cc:299] Negotiation successful
0811 07:36:37.870022 (+ 466us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":215,"threads_started":1}
I20260811 07:36:37.877278 13658 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:37.885382 13658 catalog_manager.cc:1347] Generated new cluster ID: 5306f168cc97429d98d52ee9f9a1cdcf
I20260811 07:36:37.885627 13658 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:36:37.905836 13658 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:36:37.908211 13658 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:36:37.916011 13658 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Generated new TSK 0
I20260811 07:36:37.917038 13658 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:36:37.972189 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34955
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:38.117321 13683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:38.117672 13683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:38.117722 13683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:38.123121 13683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:38.123216 13683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:38.123392 13683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:36:38.132169 13683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13683
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:38.133837 13683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:38.135267 13683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:38.149178 13690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:38.149154 13689 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:38.149219 13692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:38.149679 13683 server_base.cc:1034] running on GCE node
I20260811 07:36:38.150617 13683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:38.151779 13683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:38.153057 13683 hybrid_clock.cc:648] HybridClock initialized: now 1786433798153017 us; error 61 us; skew 500 ppm
Aug 11 07:36:38 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433798, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:38.157527 13683 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:36:38.158963 13683 webserver.cc:460] Webserver started at http://127.22.4.193:41029/ using document root <none> and password file <none>
I20260811 07:36:38.159716 13683 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:38.159829 13683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:38.160259 13683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:38.163473 13683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "f24bf0fa217d41f99c062f3b1b093af9"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "66f800fc51ae3ad4c0661af2dd565754"
server_key_iv: "860e88278c1f64908b9bf94a6d411117"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.164525 13683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "f24bf0fa217d41f99c062f3b1b093af9"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "66f800fc51ae3ad4c0661af2dd565754"
server_key_iv: "860e88278c1f64908b9bf94a6d411117"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.170315 13683 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:36:38.175146 13704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.177356 13683 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:36:38.177642 13683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "f24bf0fa217d41f99c062f3b1b093af9"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "66f800fc51ae3ad4c0661af2dd565754"
server_key_iv: "860e88278c1f64908b9bf94a6d411117"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.177829 13683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:38.205597 13683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:38.212687 13683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:38.213021 13683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:38.213971 13683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:38.215301 13683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:38.215397 13683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.215493 13683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:38.215545 13683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.232883 13683 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:39263
I20260811 07:36:38.232897 13896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:39263 every 8 connection(s)
I20260811 07:36:38.234234 13683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:36:38.235594 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 13683
I20260811 07:36:38.235760 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:36:38.236434 22547 external_mini_cluster.cc:1428] Setting key 4cd22ad67b8410feea4c30d8f77c7d7e
Aug 11 07:36:38 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433798, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:36:38.267513 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:38.237515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:44781 (local address 127.22.4.254:34955)
0811 07:36:38.237744 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:38.237750 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:38.240039 (+ 2289us) server_negotiation.cc:407] Connection header received
0811 07:36:38.241754 (+ 1715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:38.241761 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:38.241874 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:38.242366 (+ 492us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:38.244995 (+ 2629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.245827 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.250275 (+ 4448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.250664 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.250956 (+ 292us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:38.258181 (+ 7225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:38.258187 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:38.258189 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:38.258245 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:38.261131 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:38.262577 (+ 1446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:38.262582 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:38.262583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:38.262912 (+ 329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:38.263992 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:38.264000 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:38.264005 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:38.264634 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:38.264812 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:38.267024 (+ 2212us) server_negotiation.cc:299] Negotiation successful
0811 07:36:38.267283 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:36:38.268652 13899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:38.238360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:44781)
0811 07:36:38.239720 (+ 1360us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:38.239831 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:38.241359 (+ 1528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:38.243131 (+ 1772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:38.243143 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:38.243765 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:38.244637 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:38.244669 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.246123 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.246130 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:38.249836 (+ 3706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:38.249886 (+ 50us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.251354 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.251371 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:38.253092 (+ 1721us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:38.254213 (+ 1121us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:38.254245 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:38.257552 (+ 3307us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:38.261429 (+ 3877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:38.261441 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:38.261475 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:38.262198 (+ 723us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:38.263218 (+ 1020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:38.263224 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:38.263226 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:38.263569 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:38.265057 (+ 1488us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:38.265069 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:38.265575 (+ 506us) client_negotiation.cc:769] Sending connection context
0811 07:36:38.266776 (+ 1201us) client_negotiation.cc:240] Negotiation successful
0811 07:36:38.267427 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":940,"thread_start_us":244,"threads_started":1}
I20260811 07:36:38.270992 13897 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34955
I20260811 07:36:38.271364 13897 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:38.272564 13897 heartbeater.cc:511] Master 127.22.4.254:34955 requested a full tablet report, sending...
I20260811 07:36:38.275295 13591 ts_manager.cc:194] Registered new tserver with Master: f24bf0fa217d41f99c062f3b1b093af9 (127.22.4.193:39263)
I20260811 07:36:38.276973 13591 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:44781
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:36:38.304379 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34955
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:38.480228 13903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:38.480736 13903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:38.480803 13903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:38.487136 13903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:38.487286 13903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:38.487367 13903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:36:38.495141 13903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:38.496865 13903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:38.498505 13903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:38.513280 13912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:38.513314 13914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:38.513280 13911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:38.513661 13903 server_base.cc:1034] running on GCE node
I20260811 07:36:38.514493 13903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:38.515579 13903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:38.516830 13903 hybrid_clock.cc:648] HybridClock initialized: now 1786433798516796 us; error 54 us; skew 500 ppm
Aug 11 07:36:38 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433798, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:38.521458 13903 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:36:38.523031 13903 webserver.cc:460] Webserver started at http://127.22.4.194:39351/ using document root <none> and password file <none>
I20260811 07:36:38.523871 13903 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:38.523957 13903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:38.524210 13903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:38.527500 13903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "9263cecdd6b34f6bb58292cad21e106f"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "20656f614680789dab00699f8dac2150"
server_key_iv: "5332286a6bc7986a874d9b0863b5ddb7"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.528375 13903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "9263cecdd6b34f6bb58292cad21e106f"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "20656f614680789dab00699f8dac2150"
server_key_iv: "5332286a6bc7986a874d9b0863b5ddb7"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.534605 13903 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:36:38.539119 13929 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.541448 13903 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:36:38.541697 13903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "9263cecdd6b34f6bb58292cad21e106f"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "20656f614680789dab00699f8dac2150"
server_key_iv: "5332286a6bc7986a874d9b0863b5ddb7"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.541917 13903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:38.557902 13903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:38.562920 13903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:38.563235 13903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:38.564157 13903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:38.565367 13903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:38.565459 13903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.565539 13903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:38.565601 13903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.582576 13903 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:39871
I20260811 07:36:38.582801 14103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:39871 every 8 connection(s)
I20260811 07:36:38.584288 13903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:36:38.591318 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 13903
I20260811 07:36:38.591593 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:36:38.591988 22547 external_mini_cluster.cc:1428] Setting key 0a4f454b6caa52b7812a43b5a7860b7a
Aug 11 07:36:38 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433798, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:36:38.606097 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:38.587913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:45755 (local address 127.22.4.254:34955)
0811 07:36:38.588172 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:38.588177 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:38.589756 (+ 1579us) server_negotiation.cc:407] Connection header received
0811 07:36:38.591270 (+ 1514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:38.591274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:38.591362 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:38.591460 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:38.593466 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.594219 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.595770 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.596152 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.596389 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:38.600611 (+ 4222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:38.600616 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:38.600619 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:38.600658 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:38.603232 (+ 2574us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:38.604062 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:38.604066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:38.604067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:38.604167 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:38.604611 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:38.604615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:38.604617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:38.604875 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:38.604993 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:38.605701 (+ 708us) server_negotiation.cc:299] Negotiation successful
0811 07:36:38.605889 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 07:36:38.607507 14110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:38.588330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:45755)
0811 07:36:38.589426 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:38.589501 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:38.590937 (+ 1436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:38.591787 (+ 850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:38.591798 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:38.592422 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:38.593281 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:38.593302 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.594397 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.594400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:38.595599 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:38.595627 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.596465 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.596470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:38.596732 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:38.597718 (+ 986us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:38.597742 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:38.600276 (+ 2534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:38.603447 (+ 3171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:38.603456 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:38.603480 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:38.603893 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:38.604278 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:38.604282 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:38.604286 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:38.604487 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:38.605010 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:38.605021 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:38.605398 (+ 377us) client_negotiation.cc:769] Sending connection context
0811 07:36:38.605651 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 07:36:38.606160 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":768,"thread_start_us":179,"threads_started":1}
I20260811 07:36:38.609956 14106 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34955
I20260811 07:36:38.610476 14106 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:36:38.611907 14106 heartbeater.cc:511] Master 127.22.4.254:34955 requested a full tablet report, sending...
I20260811 07:36:38.614554 13591 ts_manager.cc:194] Registered new tserver with Master: 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
I20260811 07:36:38.616151 13591 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:45755
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:36:38.644168 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34955
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:38.836689 14116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:38.837085 14116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:38.837146 14116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:38.843884 14116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:38.844210 14116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:38.844313 14116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:36:38.853879 14116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:38.855543 14116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:38.857335 14116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:38.874104 14128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:38.874140 14127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:38.874477 14131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:38.875957 14116 server_base.cc:1034] running on GCE node
I20260811 07:36:38.876941 14116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:38.878010 14116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:38.881609 14116 hybrid_clock.cc:648] HybridClock initialized: now 1786433798881412 us; error 139 us; skew 500 ppm
Aug 11 07:36:38 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433798, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:38.887774 14116 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:36:38.889480 14116 webserver.cc:460] Webserver started at http://127.22.4.195:35233/ using document root <none> and password file <none>
I20260811 07:36:38.890483 14116 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:38.890630 14116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:38.891155 14116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:36:38.894919 14116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "476afae71402c966526668548e47020c"
server_key_iv: "8da170e6b5025eb8e2e7f692cc168394"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.896028 14116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "476afae71402c966526668548e47020c"
server_key_iv: "8da170e6b5025eb8e2e7f692cc168394"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.903489 14116 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260811 07:36:38.909673 14141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.914255 14116 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.006s sys 0.000s
I20260811 07:36:38.914552 14116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "476afae71402c966526668548e47020c"
server_key_iv: "8da170e6b5025eb8e2e7f692cc168394"
server_key_version: "encryptionkey@0"
I20260811 07:36:38.914790 14116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:38.934801 14116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:38.940135 14116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:38.940448 14116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:38.941593 14116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:38.943138 14116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:36:38.943226 14116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.943315 14116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:36:38.943360 14116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:38.959213 14116 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:43681
I20260811 07:36:38.959415 14331 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:43681 every 8 connection(s)
I20260811 07:36:38.961175 14116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:36:38.962181 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 14116
I20260811 07:36:38.962435 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:36:38.962864 22547 external_mini_cluster.cc:1428] Setting key 6d40d0cd3e28e34c784c427ea46d2826
Aug 11 07:36:38 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433798, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:36:38.985761 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:38.965415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:49853 (local address 127.22.4.254:34955)
0811 07:36:38.965692 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:38.965771 (+ 79us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:38.967549 (+ 1778us) server_negotiation.cc:407] Connection header received
0811 07:36:38.969048 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:38.969052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:38.969137 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:38.969250 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:38.971164 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.972103 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.973898 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.974173 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.974578 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:38.978991 (+ 4413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:38.978995 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:38.978998 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:38.979032 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:38.981078 (+ 2046us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:38.982622 (+ 1544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:38.982626 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:38.982628 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:38.982881 (+ 253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:38.983763 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:38.983767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:38.983769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:38.984141 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:38.984271 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:38.985204 (+ 933us) server_negotiation.cc:299] Negotiation successful
0811 07:36:38.985582 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 07:36:38.986969 14334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:38.965969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:49853)
0811 07:36:38.967208 (+ 1239us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:38.967276 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:38.968740 (+ 1464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:38.969508 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:38.969517 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:38.970004 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:36:38.970722 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:38.970743 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.972335 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.972339 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:38.973646 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:38.973663 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:38.974660 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:38.974740 (+ 80us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:38.975090 (+ 350us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:38.976103 (+ 1013us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:36:38.976126 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:36:38.978591 (+ 2465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:36:38.981349 (+ 2758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:38.981361 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:38.981395 (+ 34us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:38.982296 (+ 901us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:38.983084 (+ 788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:36:38.983088 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:36:38.983089 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:36:38.983449 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:36:38.984378 (+ 929us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:36:38.984387 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:36:38.984834 (+ 447us) client_negotiation.cc:769] Sending connection context
0811 07:36:38.985080 (+ 246us) client_negotiation.cc:240] Negotiation successful
0811 07:36:38.985549 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":942,"thread_start_us":332,"threads_started":1}
I20260811 07:36:38.989176 14332 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34955
I20260811 07:36:38.989600 14332 heartbeater.cc:464] Registering TS with master...
I20260811 07:36:38.990927 14332 heartbeater.cc:511] Master 127.22.4.254:34955 requested a full tablet report, sending...
I20260811 07:36:38.992998 13591 ts_manager.cc:194] Registered new tserver with Master: 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681)
I20260811 07:36:38.993925 13591 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:49853
I20260811 07:36:38.995836 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:36:39.018514 13646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:38.998809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36858 (local address 127.22.4.254:34955)
0811 07:36:38.999057 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:38.999062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:38.999225 (+ 163us) server_negotiation.cc:407] Connection header received
0811 07:36:38.999443 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:38.999447 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:38.999527 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:38.999662 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:36:39.000889 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.001624 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.002762 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.003180 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.003315 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.013154 (+ 9839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:36:39.013160 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:36:39.013162 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:36:39.013212 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:36:39.015337 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:39.016599 (+ 1262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:39.016604 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:39.016605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:39.016738 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:36:39.017181 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:36:39.017185 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:36:39.017186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:36:39.017532 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:36:39.017665 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:39.018149 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 07:36:39.018344 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260811 07:36:39.025593 13591 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36858:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:36:39.029505 13591 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:36:39.054415 14347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.046299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:39263 (local address 127.0.0.1:55904)
0811 07:36:39.047587 (+ 1288us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:39.047662 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:39.047850 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:39.048753 (+ 903us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:39.048762 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:39.048815 (+ 53us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:39.049116 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.049125 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.050796 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.050800 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.052311 (+ 1511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.052324 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.053611 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.053615 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.053782 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.053844 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 07:36:39.054002 (+ 158us) client_negotiation.cc:240] Negotiation successful
0811 07:36:39.054201 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":997,"mutex_wait_us":6,"spinlock_wait_cycles":6016,"thread_start_us":181,"threads_started":1}
I20260811 07:36:39.055229 14350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.046362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:39871 (local address 127.0.0.1:43676)
0811 07:36:39.047587 (+ 1225us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:39.047662 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:39.047850 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:39.048943 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:39.048947 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:39.048975 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:39.049194 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.049203 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.051411 (+ 2208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.051415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.052834 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.052849 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.054476 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.054481 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.054776 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.054807 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:36:39.054920 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 07:36:39.055033 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":992,"mutex_wait_us":82,"spinlock_wait_cycles":7936,"thread_start_us":252,"threads_started":1}
I20260811 07:36:39.055528 14362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.048064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44172 (local address 127.22.4.195:43681)
0811 07:36:39.048483 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:39.048513 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:39.048947 (+ 434us) server_negotiation.cc:407] Connection header received
0811 07:36:39.049050 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:39.049056 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:39.049260 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:39.049445 (+ 185us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:39.049783 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.051696 (+ 1913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.053187 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.054062 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.054167 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.054352 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:39.055163 (+ 811us) server_negotiation.cc:299] Negotiation successful
0811 07:36:39.055311 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":148,"threads_started":1}
I20260811 07:36:39.055486 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.047478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:43681 (local address 127.0.0.1:44172)
0811 07:36:39.048647 (+ 1169us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:39.048668 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:39.048821 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:39.049466 (+ 645us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:39.049470 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:39.049502 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:39.049619 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.049626 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.051880 (+ 2254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.051884 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.053047 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.053055 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.054427 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.054434 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.054539 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.054564 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 07:36:39.054952 (+ 388us) client_negotiation.cc:240] Negotiation successful
0811 07:36:39.055230 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1026,"mutex_wait_us":10,"spinlock_wait_cycles":5760,"thread_start_us":146,"threads_started":1}
I20260811 07:36:39.055910 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.046533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55904 (local address 127.22.4.193:39263)
0811 07:36:39.047226 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:39.048101 (+ 875us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:39.048140 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:36:39.048244 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:39.048250 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:39.048499 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:39.048690 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:39.049292 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.050604 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.052491 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.053429 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.053579 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.053811 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:39.054091 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 07:36:39.054263 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":193,"threads_started":1}
I20260811 07:36:39.056319 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.046559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43676 (local address 127.22.4.194:39871)
0811 07:36:39.048191 (+ 1632us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:39.048209 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:39.048229 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:36:39.048304 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:39.048308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:39.048499 (+ 191us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:39.048690 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:39.049380 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.051209 (+ 1829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.053040 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.054074 (+ 1034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.054213 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.054384 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:39.055947 (+ 1563us) server_negotiation.cc:299] Negotiation successful
0811 07:36:39.056140 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1506,"thread_start_us":85,"threads_started":1}
I20260811 07:36:39.060356 14005 tablet_service.cc:1467] Processing CreateTablet for tablet 8a85edb65e4648f0bdf8b815f094cb35 (DEFAULT_TABLE table=test-table [id=da0a5dce1d5c4456ad58492525172409]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:39.060108 14220 tablet_service.cc:1467] Processing CreateTablet for tablet 8a85edb65e4648f0bdf8b815f094cb35 (DEFAULT_TABLE table=test-table [id=da0a5dce1d5c4456ad58492525172409]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:39.062176 14005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a85edb65e4648f0bdf8b815f094cb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:39.062382 14220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a85edb65e4648f0bdf8b815f094cb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:39.062364 13793 tablet_service.cc:1467] Processing CreateTablet for tablet 8a85edb65e4648f0bdf8b815f094cb35 (DEFAULT_TABLE table=test-table [id=da0a5dce1d5c4456ad58492525172409]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:36:39.064055 13793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a85edb65e4648f0bdf8b815f094cb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:36:39.074226 14363 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Bootstrap starting.
I20260811 07:36:39.075136 14365 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: Bootstrap starting.
I20260811 07:36:39.075260 14364 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Bootstrap starting.
I20260811 07:36:39.077708 14363 tablet_bootstrap.cc:654] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:39.078298 14365 tablet_bootstrap.cc:654] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:39.078802 14364 tablet_bootstrap.cc:654] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Neither blocks nor log segments found. Creating new log.
I20260811 07:36:39.079208 14363 log.cc:824] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:39.080127 14365 log.cc:824] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:39.080127 14364 log.cc:824] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:39.083513 14365 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: No bootstrap required, opened a new log
I20260811 07:36:39.083546 14364 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: No bootstrap required, opened a new log
I20260811 07:36:39.083565 14363 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: No bootstrap required, opened a new log
I20260811 07:36:39.083827 14365 ts_tablet_manager.cc:1397] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260811 07:36:39.083822 14364 ts_tablet_manager.cc:1397] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.005s
I20260811 07:36:39.083886 14363 ts_tablet_manager.cc:1397] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260811 07:36:39.088888 14363 raft_consensus.cc:348] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.089360 14363 raft_consensus.cc:374] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:39.089447 14363 raft_consensus.cc:729] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24bf0fa217d41f99c062f3b1b093af9, State: Initialized, Role: FOLLOWER
I20260811 07:36:39.089027 14364 raft_consensus.cc:348] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.089027 14365 raft_consensus.cc:348] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.089838 14365 raft_consensus.cc:374] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:39.089824 14364 raft_consensus.cc:374] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:36:39.089912 14364 raft_consensus.cc:729] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef7a82f624f4fdfa79e8377fbeaa63d, State: Initialized, Role: FOLLOWER
I20260811 07:36:39.089912 14365 raft_consensus.cc:729] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9263cecdd6b34f6bb58292cad21e106f, State: Initialized, Role: FOLLOWER
I20260811 07:36:39.090060 14363 consensus_queue.cc:260] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.090603 14364 consensus_queue.cc:260] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.090603 14365 consensus_queue.cc:260] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.091980 13897 heartbeater.cc:503] Master 127.22.4.254:34955 was elected leader, sending a full tablet report...
I20260811 07:36:39.092054 14363 ts_tablet_manager.cc:1428] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Time spent starting tablet: real 0.008s user 0.004s sys 0.005s
I20260811 07:36:39.092103 14364 ts_tablet_manager.cc:1428] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 07:36:39.092103 14365 ts_tablet_manager.cc:1428] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20260811 07:36:39.092639 14106 heartbeater.cc:503] Master 127.22.4.254:34955 was elected leader, sending a full tablet report...
I20260811 07:36:39.093329 14332 heartbeater.cc:503] Master 127.22.4.254:34955 was elected leader, sending a full tablet report...
I20260811 07:36:39.168557 14376 raft_consensus.cc:482] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:36:39.168848 14376 raft_consensus.cc:504] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.170326 14376 leader_election.cc:288] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871), f24bf0fa217d41f99c062f3b1b093af9 (127.22.4.193:39263)
I20260811 07:36:39.175423 14352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.171102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:55319 (local address 127.22.4.193:39263)
0811 07:36:39.171368 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:39.171374 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:39.171392 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:36:39.171451 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:39.171454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:39.171504 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:39.171613 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:39.171983 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.172694 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.174109 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.174633 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.174814 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.174925 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:39.175146 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 07:36:39.175245 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260811 07:36:39.175423 14334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.170811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:39263 (local address 127.22.4.195:55319)
0811 07:36:39.171018 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:39.171040 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:39.171213 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:39.171637 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:39.171641 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:39.171662 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:39.171818 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.171826 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.172859 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.172865 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.173927 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.173943 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.174807 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.174812 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.174989 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.175013 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:36:39.175123 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 07:36:39.175237 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 07:36:39.175998 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.171130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:48471 (local address 127.22.4.194:39871)
0811 07:36:39.171298 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:39.171303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:39.171998 (+ 695us) server_negotiation.cc:407] Connection header received
0811 07:36:39.172309 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:39.172314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:39.172393 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:39.172520 (+ 127us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:36:39.172878 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.173533 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.174677 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.175195 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.175338 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.175415 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:39.175668 (+ 253us) server_negotiation.cc:299] Negotiation successful
0811 07:36:39.175782 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:36:39.176523 14377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.171371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:39871 (local address 127.22.4.195:48471)
0811 07:36:39.171864 (+ 493us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:39.171879 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:36:39.172127 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:36:39.172547 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:36:39.172550 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:36:39.172568 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:36:39.172755 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.172761 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.173667 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.173671 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.174534 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:36:39.174544 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.175334 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.175339 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:36:39.175457 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.175484 (+ 27us) client_negotiation.cc:769] Sending connection context
0811 07:36:39.176267 (+ 783us) client_negotiation.cc:240] Negotiation successful
0811 07:36:39.176381 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":183,"threads_started":1}
I20260811 07:36:39.176522 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a85edb65e4648f0bdf8b815f094cb35" candidate_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24bf0fa217d41f99c062f3b1b093af9" is_pre_election: true
I20260811 07:36:39.177028 13823 raft_consensus.cc:2454] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef7a82f624f4fdfa79e8377fbeaa63d in term 0.
I20260811 07:36:39.177510 14036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a85edb65e4648f0bdf8b815f094cb35" candidate_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9263cecdd6b34f6bb58292cad21e106f" is_pre_election: true
I20260811 07:36:39.177845 14146 leader_election.cc:302] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ef7a82f624f4fdfa79e8377fbeaa63d, f24bf0fa217d41f99c062f3b1b093af9; no voters:
I20260811 07:36:39.178040 14036 raft_consensus.cc:2454] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ef7a82f624f4fdfa79e8377fbeaa63d in term 0.
I20260811 07:36:39.178354 14376 raft_consensus.cc:2781] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:36:39.178474 14376 raft_consensus.cc:482] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:36:39.178512 14376 raft_consensus.cc:3037] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:39.180140 14376 raft_consensus.cc:504] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.180704 14376 leader_election.cc:288] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [CANDIDATE]: Term 1 election: Requested vote from peers 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871), f24bf0fa217d41f99c062f3b1b093af9 (127.22.4.193:39263)
I20260811 07:36:39.181437 14036 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a85edb65e4648f0bdf8b815f094cb35" candidate_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9263cecdd6b34f6bb58292cad21e106f"
I20260811 07:36:39.181849 14036 raft_consensus.cc:3037] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:39.181986 13823 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a85edb65e4648f0bdf8b815f094cb35" candidate_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f24bf0fa217d41f99c062f3b1b093af9"
I20260811 07:36:39.182183 13823 raft_consensus.cc:3037] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:36:39.184283 14036 raft_consensus.cc:2454] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef7a82f624f4fdfa79e8377fbeaa63d in term 1.
I20260811 07:36:39.184787 13823 raft_consensus.cc:2454] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ef7a82f624f4fdfa79e8377fbeaa63d in term 1.
I20260811 07:36:39.185207 14145 leader_election.cc:302] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ef7a82f624f4fdfa79e8377fbeaa63d, 9263cecdd6b34f6bb58292cad21e106f; no voters:
I20260811 07:36:39.185686 14376 raft_consensus.cc:2781] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:36:39.186100 14376 raft_consensus.cc:686] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 LEADER]: Becoming Leader. State: Replica: 2ef7a82f624f4fdfa79e8377fbeaa63d, State: Running, Role: LEADER
I20260811 07:36:39.187078 14376 consensus_queue.cc:237] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:36:39.193958 13589 catalog_manager.cc:5495] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195). New cstate: current_term: 1 leader_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } health_report { overall_health: HEALTHY } } }
W20260811 07:36:39.213081 14333 tablet.cc:2369] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:39.226630 14362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.219698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44178 (local address 127.22.4.195:43681)
0811 07:36:39.219999 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0811 07:36:39.220005 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:36:39.220064 (+ 59us) server_negotiation.cc:407] Connection header received
0811 07:36:39.220268 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:36:39.220272 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:36:39.220379 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:36:39.220819 (+ 440us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:36:39.220971 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.221695 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.223832 (+ 2137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:36:39.224119 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:36:39.224251 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:36:39.224946 (+ 695us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:36:39.225635 (+ 689us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:36:39.225978 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0811 07:36:39.226230 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 07:36:39.226328 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
W20260811 07:36:39.236956 13898 tablet.cc:2369] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:36:39.237385 13823 raft_consensus.cc:1261] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Refusing update from remote peer 2ef7a82f624f4fdfa79e8377fbeaa63d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:39.237929 14036 raft_consensus.cc:1261] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 1 FOLLOWER]: Refusing update from remote peer 2ef7a82f624f4fdfa79e8377fbeaa63d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:36:39.238672 14376 consensus_queue.cc:1035] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:39.239234 14378 consensus_queue.cc:1035] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:36:39.256683 14382 mvcc.cc:205] Tried to move back new op lower bound from 7317232841661652992 to 7317232841474932736. Current Snapshot: MvccSnapshot[applied={T|T < 7317232841661652992}]
I20260811 07:36:39.261252 14383 mvcc.cc:205] Tried to move back new op lower bound from 7317232841661652992 to 7317232841474932736. Current Snapshot: MvccSnapshot[applied={T|T < 7317232841661652992}]
I20260811 07:36:39.275799 13589 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:36:39.276105 13589 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36858:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:36:39.281476 13589 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Sending DeleteTablet for 3 replicas of tablet 8a85edb65e4648f0bdf8b815f094cb35
I20260811 07:36:39.284498 14005 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a85edb65e4648f0bdf8b815f094cb35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:39 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:43676
I20260811 07:36:39.285015 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 13683
I20260811 07:36:39.308274 14393 tablet_replica.cc:330] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: stopping tablet replica
I20260811 07:36:39.309237 14393 raft_consensus.cc:2229] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:36:39.309983 14393 raft_consensus.cc:2258] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:39.312834 14220 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a85edb65e4648f0bdf8b815f094cb35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:39 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:44172
I20260811 07:36:39.316555 14394 tablet_replica.cc:330] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: stopping tablet replica
I20260811 07:36:39.317294 14394 raft_consensus.cc:2229] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:36:39.317384 14393 ts_tablet_manager.cc:1905] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:39.318284 14394 raft_consensus.cc:2258] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:36:39.322584 14394 ts_tablet_manager.cc:1905] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:36:39.323632 14393 ts_tablet_manager.cc:1918] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:39.323920 14393 log.cc:1196] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/8a85edb65e4648f0bdf8b815f094cb35
I20260811 07:36:39.325381 14393 ts_tablet_manager.cc:1939] T 8a85edb65e4648f0bdf8b815f094cb35 P 9263cecdd6b34f6bb58292cad21e106f: Deleting consensus metadata
I20260811 07:36:39.328188 13558 catalog_manager.cc:4841] TS 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871): tablet 8a85edb65e4648f0bdf8b815f094cb35 (table test-table [id=da0a5dce1d5c4456ad58492525172409]) successfully deleted
I20260811 07:36:39.330751 14394 ts_tablet_manager.cc:1918] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:36:39.331024 14394 log.cc:1196] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/8a85edb65e4648f0bdf8b815f094cb35
I20260811 07:36:39.331652 14394 ts_tablet_manager.cc:1939] T 8a85edb65e4648f0bdf8b815f094cb35 P 2ef7a82f624f4fdfa79e8377fbeaa63d: Deleting consensus metadata
W20260811 07:36:39.333595 13559 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:39263 (error 108)
I20260811 07:36:39.333900 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 13903
I20260811 07:36:39.349295 13562 catalog_manager.cc:4841] TS 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681): tablet 8a85edb65e4648f0bdf8b815f094cb35 (table test-table [id=da0a5dce1d5c4456ad58492525172409]) successfully deleted
I20260811 07:36:39.351223 14357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:36:39.350042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:39263 (local address 127.0.0.1:55914)
0811 07:36:39.350466 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0811 07:36:39.350789 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:39263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271}
W20260811 07:36:39.351871 13559 catalog_manager.cc:4584] TS f24bf0fa217d41f99c062f3b1b093af9 (127.22.4.193:39263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8a85edb65e4648f0bdf8b815f094cb35: Network error: Client connection negotiation failed: client connection to 127.22.4.193:39263: connect: Connection refused (error 111)
I20260811 07:36:39.368799 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 14116
I20260811 07:36:39.405742 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 13529
I20260811 07:36:59.423465 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34955
--webserver_interface=127.22.4.254
--webserver_port=37983
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:36:59.598766 14399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:59.599270 14399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:59.599366 14399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:59.604635 14399 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:36:59.604832 14399 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:36:59.604863 14399 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:36:59.604887 14399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:36:59.604923 14399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:59.604966 14399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:59.605027 14399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:36:59.605067 14399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:36:59.613567 14399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=37983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:59.615478 14399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:59.617178 14399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:59.638409 14419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:59.638408 14412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:59.638408 14409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:59.639258 14399 server_base.cc:1034] running on GCE node
I20260811 07:36:59.640136 14399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:59.641652 14399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:59.645135 14399 hybrid_clock.cc:648] HybridClock initialized: now 1786433819645059 us; error 86 us; skew 500 ppm
Aug 11 07:36:59 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433819, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:59.657145 14399 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:36:59.658644 14399 webserver.cc:460] Webserver started at http://127.22.4.254:37983/ using document root <none> and password file <none>
I20260811 07:36:59.659467 14399 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:59.659560 14399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:59.664772 14399 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260811 07:36:59.668252 14428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:59.670423 14399 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:36:59.670617 14399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "641d1dc29e46470591b9fa67bae8dc07"
format_stamp: "Formatted at 2026-08-11 07:36:37 on dist-test-slave-7z32"
server_key: "519c361d54fc88c0273a0b29d8970c6e"
server_key_iv: "c872d967db1b752fd0f2e4ff2d87efa7"
server_key_version: "encryptionkey@0"
I20260811 07:36:59.671514 14399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:59.716023 14399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:59.720933 14399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:59.721170 14399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:59.731675 14399 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:34955
I20260811 07:36:59.732203 14513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:34955 every 8 connection(s)
I20260811 07:36:59.733233 14399 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:36:59.739611 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 14399
I20260811 07:36:59.740247 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:39263
--local_ip_for_outbound_sockets=127.22.4.193
--tserver_master_addrs=127.22.4.254:34955
--webserver_port=41029
--webserver_interface=127.22.4.193
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:36:59.740399 14519 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:36:59.743189 14519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Bootstrap starting.
I20260811 07:36:59.769867 14519 log.cc:824] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Log is configured to *not* fsync() on all Append() calls
I20260811 07:36:59.782299 14519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:36:59.783007 14519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Bootstrap complete.
I20260811 07:36:59.789173 14519 raft_consensus.cc:348] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:36:59.790509 14519 raft_consensus.cc:729] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641d1dc29e46470591b9fa67bae8dc07, State: Initialized, Role: FOLLOWER
I20260811 07:36:59.791971 14519 consensus_queue.cc:260] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:36:59.792270 14519 raft_consensus.cc:388] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:36:59.792402 14519 raft_consensus.cc:482] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:36:59.792550 14519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 1 FOLLOWER]: Advancing to term 2
I20260811 07:36:59.796933 14519 raft_consensus.cc:504] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:36:59.797636 14519 leader_election.cc:302] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 641d1dc29e46470591b9fa67bae8dc07; no voters:
I20260811 07:36:59.798346 14519 leader_election.cc:288] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 07:36:59.798514 14523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 07:36:59.799190 14523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 2 LEADER]: Becoming Leader. State: Replica: 641d1dc29e46470591b9fa67bae8dc07, State: Running, Role: LEADER
I20260811 07:36:59.799718 14523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:36:59.801177 14519 sys_catalog.cc:564] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:36:59.802546 14525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 641d1dc29e46470591b9fa67bae8dc07. Latest consensus state: current_term: 2 leader_uuid: "641d1dc29e46470591b9fa67bae8dc07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } } }
I20260811 07:36:59.803354 14525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:59.802510 14524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "641d1dc29e46470591b9fa67bae8dc07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } } }
I20260811 07:36:59.803803 14524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: This master's current role is: LEADER
I20260811 07:36:59.804258 14535 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:36:59.816051 14535 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:36:59.817308 14535 catalog_manager.cc:1259] Loaded cluster ID: 5306f168cc97429d98d52ee9f9a1cdcf
I20260811 07:36:59.817405 14535 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:36:59.820960 14535 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:36:59.822216 14535 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Loaded TSK: 0
I20260811 07:36:59.841836 14535 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Generated new TSK 1
I20260811 07:36:59.842268 14535 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:36:59.914063 14521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:36:59.914601 14521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:36:59.914682 14521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:36:59.919328 14521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:36:59.919420 14521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:36:59.919489 14521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:36:59.925505 14521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:39263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=41029
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:36:59.926880 14521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:36:59.928170 14521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:36:59.939656 14562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:59.939648 14563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:36:59.939648 14566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:36:59.940466 14521 server_base.cc:1034] running on GCE node
I20260811 07:36:59.940968 14521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:36:59.941702 14521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:36:59.942904 14521 hybrid_clock.cc:648] HybridClock initialized: now 1786433819942873 us; error 52 us; skew 500 ppm
Aug 11 07:36:59 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433819, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:36:59.946281 14521 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:36:59.947580 14521 webserver.cc:460] Webserver started at http://127.22.4.193:41029/ using document root <none> and password file <none>
I20260811 07:36:59.948264 14521 fs_manager.cc:359] Metadata directory not provided
I20260811 07:36:59.948354 14521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:36:59.952877 14521 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260811 07:36:59.955504 14575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:36:59.956988 14521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260811 07:36:59.957115 14521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "f24bf0fa217d41f99c062f3b1b093af9"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "66f800fc51ae3ad4c0661af2dd565754"
server_key_iv: "860e88278c1f64908b9bf94a6d411117"
server_key_version: "encryptionkey@0"
I20260811 07:36:59.957787 14521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:36:59.968858 14521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:36:59.972882 14521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:36:59.973079 14521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:36:59.973810 14521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:36:59.975495 14592 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:36:59.981493 14521 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:36:59.981622 14521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260811 07:36:59.981730 14521 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:36:59.986253 14521 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:36:59.986384 14521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.005s user 0.001s sys 0.000s
I20260811 07:36:59.986896 14592 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Bootstrap starting.
I20260811 07:37:00.009893 14760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:39263 every 8 connection(s)
I20260811 07:37:00.009598 14521 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:39263
I20260811 07:37:00.013650 14521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:37:00.024008 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 14521
I20260811 07:37:00.024765 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:39871
--local_ip_for_outbound_sockets=127.22.4.194
--tserver_master_addrs=127.22.4.254:34955
--webserver_port=39351
--webserver_interface=127.22.4.194
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:37:00.027891 14592 log.cc:824] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:37:00 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433819, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:00.041673 14592 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:37:00.042646 14592 tablet_bootstrap.cc:492] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Bootstrap complete.
I20260811 07:37:00.045003 14592 ts_tablet_manager.cc:1397] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Time spent bootstrapping tablet: real 0.059s user 0.029s sys 0.026s
I20260811 07:37:00.046530 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.019232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:49967)
0811 07:37:00.020900 (+ 1668us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.021223 (+ 323us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:00.024538 (+ 3315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:00.028520 (+ 3982us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:00.028531 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:00.029044 (+ 513us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:00.029678 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.029700 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.032110 (+ 2410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.032117 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.033550 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.033576 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.035049 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.035054 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.035332 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.036267 (+ 935us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:00.036290 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:00.038730 (+ 2440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:00.042055 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:00.042063 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:00.042079 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:00.042552 (+ 473us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:00.043132 (+ 580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:00.043135 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:00.043137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:00.043299 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:00.044115 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:00.044123 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:00.044439 (+ 316us) client_negotiation.cc:769] Sending connection context
0811 07:37:00.044672 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 07:37:00.045245 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1265,"thread_start_us":639,"threads_started":1}
I20260811 07:37:00.046528 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.019005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:49967 (local address 127.22.4.254:34955)
0811 07:37:00.019941 (+ 936us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.020358 (+ 417us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.021586 (+ 1228us) server_negotiation.cc:407] Connection header received
0811 07:37:00.025594 (+ 4008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.025619 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.026687 (+ 1068us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.027651 (+ 964us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:00.029997 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.031768 (+ 1771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.033850 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.034704 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.035054 (+ 350us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.039138 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:00.039146 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:00.039165 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:00.039310 (+ 145us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:00.041811 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.042738 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.042747 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.042755 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.042986 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.043418 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.043422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.043424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.043961 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:00.044133 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.044799 (+ 666us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.045155 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658,"thread_start_us":386,"threads_started":1}
I20260811 07:37:00.049129 14592 raft_consensus.cc:348] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:37:00.049813 14592 raft_consensus.cc:729] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24bf0fa217d41f99c062f3b1b093af9, State: Initialized, Role: FOLLOWER
I20260811 07:37:00.050549 14592 consensus_queue.cc:260] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } } peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } }
I20260811 07:37:00.050585 14763 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34955
I20260811 07:37:00.051119 14763 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:00.051879 14763 heartbeater.cc:511] Master 127.22.4.254:34955 requested a full tablet report, sending...
I20260811 07:37:00.051975 14592 ts_tablet_manager.cc:1428] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Time spent starting tablet: real 0.007s user 0.007s sys 0.001s
I20260811 07:37:00.055763 14460 ts_manager.cc:194] Registered new tserver with Master: f24bf0fa217d41f99c062f3b1b093af9 (127.22.4.193:39263)
I20260811 07:37:00.060964 14460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:49967
I20260811 07:37:00.065382 14763 heartbeater.cc:503] Master 127.22.4.254:34955 was elected leader, sending a full tablet report...
Aug 11 07:37:00 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433819, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.193@KRBTEST.COM
I20260811 07:37:00.078289 14775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.060507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38168 (local address 127.22.4.193:39263)
0811 07:37:00.061301 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.061319 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.062159 (+ 840us) server_negotiation.cc:407] Connection header received
0811 07:37:00.062658 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.062667 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.063029 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.063240 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:00.064311 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.066102 (+ 1791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.067982 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.068539 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.068710 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.071844 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:00.071860 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:00.071879 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:00.071914 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:00.074575 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.075411 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.075418 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.075420 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.075523 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.076345 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.076350 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.076352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.076836 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:00.077036 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.077557 (+ 521us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.078029 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":645,"thread_start_us":286,"threads_started":1}
I20260811 07:37:00.078289 14774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.060436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:39263 (local address 127.0.0.1:38168)
0811 07:37:00.061904 (+ 1468us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.061984 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:00.062369 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:00.063277 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:00.063284 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:00.063923 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:00.064127 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.064139 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.066283 (+ 2144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.066288 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.067533 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.067552 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.068766 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.068770 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.068921 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.069680 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:00.069694 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:00.071616 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:00.074783 (+ 3167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:00.074804 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:00.074813 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:00.075236 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:00.075670 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:00.075674 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:00.075676 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:00.076134 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:00.077004 (+ 870us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:00.077013 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:00.077232 (+ 219us) client_negotiation.cc:769] Sending connection context
0811 07:37:00.077431 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 07:37:00.078028 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":987,"thread_start_us":324,"threads_started":1}
I20260811 07:37:00.080384 14662 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a85edb65e4648f0bdf8b815f094cb35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:36:39 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:38168
I20260811 07:37:00.081511 14777 tablet_replica.cc:330] stopping tablet replica
I20260811 07:37:00.081940 14777 raft_consensus.cc:2229] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:00.082273 14777 raft_consensus.cc:2258] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:00.083557 14777 ts_tablet_manager.cc:1905] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:00.089745 14777 ts_tablet_manager.cc:1918] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:00.089922 14777 log.cc:1196] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal/wals/8a85edb65e4648f0bdf8b815f094cb35
I20260811 07:37:00.090262 14777 ts_tablet_manager.cc:1939] T 8a85edb65e4648f0bdf8b815f094cb35 P f24bf0fa217d41f99c062f3b1b093af9: Deleting consensus metadata
I20260811 07:37:00.093271 14437 catalog_manager.cc:4841] TS f24bf0fa217d41f99c062f3b1b093af9 (127.22.4.193:39263): tablet 8a85edb65e4648f0bdf8b815f094cb35 (table test-table [id=da0a5dce1d5c4456ad58492525172409]) successfully deleted
W20260811 07:37:00.205567 14769 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:00.206187 14769 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:00.206351 14769 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:00.211894 14769 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:00.212052 14769 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:00.212184 14769 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:37:00.219297 14769 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:39871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=39351
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14769
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:00.221104 14769 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:00.222652 14769 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:00.236584 14786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:00.236714 14769 server_base.cc:1034] running on GCE node
W20260811 07:37:00.236652 14782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:00.236618 14783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:00.237728 14769 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:00.238579 14769 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:00.241897 14769 hybrid_clock.cc:648] HybridClock initialized: now 1786433820241843 us; error 76 us; skew 500 ppm
Aug 11 07:37:00 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433820, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:00.245828 14769 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:37:00.247213 14769 webserver.cc:460] Webserver started at http://127.22.4.194:39351/ using document root <none> and password file <none>
I20260811 07:37:00.247956 14769 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:00.248049 14769 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:00.253665 14769 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260811 07:37:00.256806 14798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:00.258708 14769 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260811 07:37:00.258983 14769 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "9263cecdd6b34f6bb58292cad21e106f"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "20656f614680789dab00699f8dac2150"
server_key_iv: "5332286a6bc7986a874d9b0863b5ddb7"
server_key_version: "encryptionkey@0"
I20260811 07:37:00.259686 14769 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:00.289086 14769 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:00.294173 14769 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:00.294413 14769 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:00.295300 14769 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:00.296521 14769 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:00.296582 14769 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:00.296628 14769 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:00.296644 14769 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:00.312207 14769 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:39871
I20260811 07:37:00.312229 14981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:39871 every 8 connection(s)
I20260811 07:37:00.313560 14769 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:37:00.322661 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 14769
I20260811 07:37:00.323390 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:43681
--local_ip_for_outbound_sockets=127.22.4.195
--tserver_master_addrs=127.22.4.254:34955
--webserver_port=35233
--webserver_interface=127.22.4.195
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 07:37:00 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433820, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:00.336370 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.316735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:37575 (local address 127.22.4.254:34955)
0811 07:37:00.316939 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.316951 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.319134 (+ 2183us) server_negotiation.cc:407] Connection header received
0811 07:37:00.320463 (+ 1329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.320467 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.320556 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.320681 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:00.323231 (+ 2550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.323967 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.326601 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.327114 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.327319 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.331278 (+ 3959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:00.331283 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:00.331285 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:00.331326 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:00.333282 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.334051 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.334055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.334056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.334150 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.334572 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.334576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.334578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.335088 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:00.335220 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.335936 (+ 716us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.336152 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260811 07:37:00.337612 14986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.317251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:37575)
0811 07:37:00.318733 (+ 1482us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.318904 (+ 171us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:00.320083 (+ 1179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:00.321254 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:00.321266 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:00.321905 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:00.322933 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.322964 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.324223 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.324230 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.326275 (+ 2045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.326303 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.327405 (+ 1102us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.327410 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.327649 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.328713 (+ 1064us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:00.328749 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:00.330952 (+ 2203us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:00.333476 (+ 2524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:00.333485 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:00.333513 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:00.333894 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:00.334261 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:00.334265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:00.334267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:00.334455 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:00.335219 (+ 764us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:00.335230 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:00.335617 (+ 387us) client_negotiation.cc:769] Sending connection context
0811 07:37:00.335872 (+ 255us) client_negotiation.cc:240] Negotiation successful
0811 07:37:00.336408 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1054,"thread_start_us":742,"threads_started":1}
I20260811 07:37:00.339846 14982 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34955
I20260811 07:37:00.340296 14982 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:00.341161 14982 heartbeater.cc:511] Master 127.22.4.254:34955 requested a full tablet report, sending...
I20260811 07:37:00.343029 14460 ts_manager.cc:194] Registered new tserver with Master: 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
I20260811 07:37:00.343823 14460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:37575
W20260811 07:37:00.470993 14987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:00.471385 14987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:00.471467 14987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:00.476601 14987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:00.476716 14987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:00.476858 14987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:37:00.483063 14987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:43681
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=35233
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:00.484565 14987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:00.485942 14987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:00.499094 14997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:00.499169 15000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:00.499169 14998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:00.500255 14987 server_base.cc:1034] running on GCE node
I20260811 07:37:00.501012 14987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:00.502095 14987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:00.503471 14987 hybrid_clock.cc:648] HybridClock initialized: now 1786433820503447 us; error 42 us; skew 500 ppm
Aug 11 07:37:00 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433820, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:00.507762 14987 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:37:00.509343 14987 webserver.cc:460] Webserver started at http://127.22.4.195:35233/ using document root <none> and password file <none>
I20260811 07:37:00.510242 14987 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:00.510362 14987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:00.517669 14987 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:37:00.522004 15008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:00.524613 14987 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:37:00.524919 14987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "476afae71402c966526668548e47020c"
server_key_iv: "8da170e6b5025eb8e2e7f692cc168394"
server_key_version: "encryptionkey@0"
I20260811 07:37:00.525868 14987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:00.552692 14987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:00.557804 14987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:00.558043 14987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:00.558987 14987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:00.560160 14987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:00.560220 14987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:00.560271 14987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:00.560287 14987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:00.576176 14987 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:43681
I20260811 07:37:00.576272 15200 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:43681 every 8 connection(s)
I20260811 07:37:00.578022 14987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:37:00.588352 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 14987
Aug 11 07:37:00 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433820, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:00.601431 15208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.589713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50718 (local address 127.22.4.254:34955)
0811 07:37:00.590151 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.590156 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.590461 (+ 305us) server_negotiation.cc:407] Connection header received
0811 07:37:00.590751 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.590754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.590877 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.591007 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:00.592101 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.592685 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.593722 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.593984 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.594275 (+ 291us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.596512 (+ 2237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:00.596516 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:00.596519 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:00.596580 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:00.599121 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.599758 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.599762 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.599763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.599875 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.600254 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.600259 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.600261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.600509 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:00.600823 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.600949 (+ 126us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.601132 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":156,"threads_started":1}
I20260811 07:37:00.602000 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.581790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:58209 (local address 127.22.4.254:34955)
0811 07:37:00.582061 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.582068 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.584372 (+ 2304us) server_negotiation.cc:407] Connection header received
0811 07:37:00.585567 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.585571 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.585818 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.585951 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:00.587940 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.588972 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.591212 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.591619 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.591766 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.595266 (+ 3500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:00.595274 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:00.595281 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:00.595321 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:00.597898 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.599362 (+ 1464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.599366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.599367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.599504 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.600034 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.600037 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.600038 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.600259 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:00.600423 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.601194 (+ 771us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.601802 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 07:37:00.602784 15206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.582623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:58209)
0811 07:37:00.584095 (+ 1472us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.584180 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:00.585229 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:00.586271 (+ 1042us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:00.586281 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:00.586756 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:00.587554 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.587576 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.589340 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.589348 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.591034 (+ 1686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.591057 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.591872 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.591876 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.592060 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.592861 (+ 801us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:00.592881 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:00.594905 (+ 2024us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:00.598281 (+ 3376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:00.598295 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:00.598331 (+ 36us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:00.599073 (+ 742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:00.599648 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:00.599655 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:00.599659 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:00.599913 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:00.600455 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:00.600468 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:00.600839 (+ 371us) client_negotiation.cc:769] Sending connection context
0811 07:37:00.601090 (+ 251us) client_negotiation.cc:240] Negotiation successful
0811 07:37:00.601535 (+ 445us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1110,"thread_start_us":520,"threads_started":1}
I20260811 07:37:00.605270 15201 heartbeater.cc:347] Connected to a master server at 127.22.4.254:34955
I20260811 07:37:00.605830 15201 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:00.606788 15201 heartbeater.cc:511] Master 127.22.4.254:34955 requested a full tablet report, sending...
I20260811 07:37:00.609314 14456 ts_manager.cc:194] Registered new tserver with Master: 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681)
I20260811 07:37:00.610669 14456 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:58209
I20260811 07:37:00.617937 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:37:00.624169 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.619021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50730 (local address 127.22.4.254:34955)
0811 07:37:00.619203 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.619208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.619599 (+ 391us) server_negotiation.cc:407] Connection header received
0811 07:37:00.619776 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.619778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.619932 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.620059 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:37:00.620518 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.621117 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.622215 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.622490 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.622622 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.623516 (+ 894us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:37:00.623702 (+ 186us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 07:37:00.624038 (+ 336us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50730: token expired
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 07:37:00.624307 14767 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50730: token expired
W20260811 07:37:00.624982 14338 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.22.4.254:34955)
I20260811 07:37:00.637466 14767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.625650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50746 (local address 127.22.4.254:34955)
0811 07:37:00.625884 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.625889 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.625906 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:37:00.626109 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.626112 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.626181 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.626314 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:00.627406 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.628030 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.629241 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.629726 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.629924 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.631826 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:00.631829 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:00.631832 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:00.631871 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:00.634505 (+ 2634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.635228 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.635232 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.635234 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.635355 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:00.636048 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:00.636052 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:00.636053 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:00.636378 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:00.636545 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.636882 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.637121 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 07:37:00.641408 14456 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50746:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:37:00.645538 14456 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:37:00.657317 14662 tablet_service.cc:1467] Processing CreateTablet for tablet a5aec410b03e45c9881c94e076920a7b (DEFAULT_TABLE table=test-table [id=ebd6c4ed005a44eab8007a4126576538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:00.658149 14662 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5aec410b03e45c9881c94e076920a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:00.661780 15221 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Bootstrap starting.
I20260811 07:37:00.663003 15221 tablet_bootstrap.cc:654] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:00.663736 15218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.656522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:39871 (local address 127.0.0.1:46976)
0811 07:37:00.656970 (+ 448us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.656989 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:00.657112 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:00.658108 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:00.658112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:00.658133 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:00.658303 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.658311 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.660082 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.660108 (+ 26us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.661695 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.661707 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.663141 (+ 1434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.663145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.663247 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.663300 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 07:37:00.663364 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 07:37:00.663483 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":187,"thread_start_us":113,"threads_started":1}
I20260811 07:37:00.664031 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.656325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52588 (local address 127.22.4.195:43681)
0811 07:37:00.656975 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.656995 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.657033 (+ 38us) server_negotiation.cc:407] Connection header received
0811 07:37:00.657151 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.657161 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.657765 (+ 604us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.657987 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:00.658484 (+ 497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.659906 (+ 1422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.662047 (+ 2141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.663004 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.663121 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.663352 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.663679 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.663845 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":177,"threads_started":1}
I20260811 07:37:00.664876 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.657104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46976 (local address 127.22.4.194:39871)
0811 07:37:00.657584 (+ 480us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.657598 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.657624 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:37:00.657724 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.657729 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.657916 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.658474 (+ 558us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:00.658712 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.659911 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.661864 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.662975 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.664152 (+ 1177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.664424 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.664503 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.664677 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":174,"threads_started":1}
I20260811 07:37:00.665753 15221 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: No bootstrap required, opened a new log
I20260811 07:37:00.665920 15221 ts_tablet_manager.cc:1397] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 07:37:00.666119 15215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.656082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:43681 (local address 127.0.0.1:52588)
0811 07:37:00.656557 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.656576 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:00.656690 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:00.658241 (+ 1551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:00.658246 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:00.658277 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:00.658355 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.658364 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.660080 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.660087 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.661887 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.661895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.663168 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.663173 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.663312 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.663431 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 07:37:00.663556 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 07:37:00.663677 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":276,"thread_start_us":130,"threads_started":1}
I20260811 07:37:00.666543 15221 raft_consensus.cc:348] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.666747 15221 raft_consensus.cc:374] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:00.666806 15221 raft_consensus.cc:729] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24bf0fa217d41f99c062f3b1b093af9, State: Initialized, Role: FOLLOWER
I20260811 07:37:00.667006 15221 consensus_queue.cc:260] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.667462 15221 ts_tablet_manager.cc:1428] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 07:37:00.669059 14883 tablet_service.cc:1467] Processing CreateTablet for tablet a5aec410b03e45c9881c94e076920a7b (DEFAULT_TABLE table=test-table [id=ebd6c4ed005a44eab8007a4126576538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:00.669940 15081 tablet_service.cc:1467] Processing CreateTablet for tablet a5aec410b03e45c9881c94e076920a7b (DEFAULT_TABLE table=test-table [id=ebd6c4ed005a44eab8007a4126576538]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:00.670428 14883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5aec410b03e45c9881c94e076920a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:00.671000 15081 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5aec410b03e45c9881c94e076920a7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:00.680267 15226 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Bootstrap starting.
I20260811 07:37:00.681348 15225 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Bootstrap starting.
I20260811 07:37:00.684274 15226 tablet_bootstrap.cc:654] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:00.684859 15225 tablet_bootstrap.cc:654] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:00.686033 15225 log.cc:824] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:00.686033 15226 log.cc:824] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:00.689021 15226 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: No bootstrap required, opened a new log
I20260811 07:37:00.689414 15226 ts_tablet_manager.cc:1397] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 07:37:00.689893 15225 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: No bootstrap required, opened a new log
I20260811 07:37:00.690212 15225 ts_tablet_manager.cc:1397] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 07:37:00.693164 15226 raft_consensus.cc:348] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.693475 15226 raft_consensus.cc:374] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:00.693516 15226 raft_consensus.cc:729] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ef7a82f624f4fdfa79e8377fbeaa63d, State: Initialized, Role: FOLLOWER
I20260811 07:37:00.694109 15226 consensus_queue.cc:260] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.694020 15225 raft_consensus.cc:348] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.694370 15225 raft_consensus.cc:374] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:00.694446 15225 raft_consensus.cc:729] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9263cecdd6b34f6bb58292cad21e106f, State: Initialized, Role: FOLLOWER
I20260811 07:37:00.695050 15225 consensus_queue.cc:260] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.695132 15201 heartbeater.cc:503] Master 127.22.4.254:34955 was elected leader, sending a full tablet report...
I20260811 07:37:00.695466 15226 ts_tablet_manager.cc:1428] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Time spent starting tablet: real 0.006s user 0.000s sys 0.005s
I20260811 07:37:00.696082 14982 heartbeater.cc:503] Master 127.22.4.254:34955 was elected leader, sending a full tablet report...
I20260811 07:37:00.696620 15225 ts_tablet_manager.cc:1428] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
W20260811 07:37:00.766420 14764 tablet.cc:2369] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:00.801280 15224 raft_consensus.cc:482] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:00.801733 15224 raft_consensus.cc:504] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.803691 15224 leader_election.cc:288] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681), 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
I20260811 07:37:00.808440 15219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.804428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:52849 (local address 127.22.4.194:39871)
0811 07:37:00.804682 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.804691 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.804719 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:37:00.804982 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.804987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.805047 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.805153 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:00.805531 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.806090 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.807310 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.807742 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.807888 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.807953 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.808192 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.808277 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132}
I20260811 07:37:00.808454 15235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.804158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:39871 (local address 127.22.4.193:52849)
0811 07:37:00.804548 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.804569 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:00.804738 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:00.805166 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:00.805169 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:00.805190 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:00.805395 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.805402 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.806220 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.806225 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.807163 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.807173 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.807887 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.807891 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.808018 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.808071 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 07:37:00.808172 (+ 101us) client_negotiation.cc:240] Negotiation successful
0811 07:37:00.808277 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":4,"spinlock_wait_cycles":90368,"thread_start_us":124,"threads_started":1}
I20260811 07:37:00.809150 15217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.804695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:46175 (local address 127.22.4.195:43681)
0811 07:37:00.804880 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.804887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.805151 (+ 264us) server_negotiation.cc:407] Connection header received
0811 07:37:00.805470 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.805478 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.805538 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.805644 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:00.805963 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.806570 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.807885 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.808386 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.808547 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.808618 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.808844 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.808947 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:37:00.809665 15236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.804270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:43681 (local address 127.22.4.193:46175)
0811 07:37:00.805006 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.805021 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:00.805310 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:00.805661 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:00.805664 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:00.805685 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:00.805822 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.805829 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.806706 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.806712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.807731 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:00.807742 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.808547 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.808551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:00.808660 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.808690 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:37:00.809395 (+ 705us) client_negotiation.cc:240] Negotiation successful
0811 07:37:00.809507 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":646,"mutex_wait_us":3,"spinlock_wait_cycles":48128,"thread_start_us":199,"threads_started":1}
I20260811 07:37:00.809592 14899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5aec410b03e45c9881c94e076920a7b" candidate_uuid: "f24bf0fa217d41f99c062f3b1b093af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9263cecdd6b34f6bb58292cad21e106f" is_pre_election: true
I20260811 07:37:00.810020 14899 raft_consensus.cc:2454] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24bf0fa217d41f99c062f3b1b093af9 in term 0.
I20260811 07:37:00.810644 15121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5aec410b03e45c9881c94e076920a7b" candidate_uuid: "f24bf0fa217d41f99c062f3b1b093af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" is_pre_election: true
I20260811 07:37:00.810721 14579 leader_election.cc:302] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9263cecdd6b34f6bb58292cad21e106f, f24bf0fa217d41f99c062f3b1b093af9; no voters:
I20260811 07:37:00.811023 15121 raft_consensus.cc:2454] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f24bf0fa217d41f99c062f3b1b093af9 in term 0.
I20260811 07:37:00.811131 15224 raft_consensus.cc:2781] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:37:00.811232 15224 raft_consensus.cc:482] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:37:00.811291 15224 raft_consensus.cc:3037] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:00.812516 15224 raft_consensus.cc:504] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.812973 15224 leader_election.cc:288] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 1 election: Requested vote from peers 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681), 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
I20260811 07:37:00.813531 14899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5aec410b03e45c9881c94e076920a7b" candidate_uuid: "f24bf0fa217d41f99c062f3b1b093af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9263cecdd6b34f6bb58292cad21e106f"
I20260811 07:37:00.813623 15121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5aec410b03e45c9881c94e076920a7b" candidate_uuid: "f24bf0fa217d41f99c062f3b1b093af9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d"
I20260811 07:37:00.813710 14899 raft_consensus.cc:3037] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:00.813884 15121 raft_consensus.cc:3037] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 0 FOLLOWER]: Advancing to term 1
W20260811 07:37:00.815061 14984 tablet.cc:2369] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:00.815253 14899 raft_consensus.cc:2454] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24bf0fa217d41f99c062f3b1b093af9 in term 1.
I20260811 07:37:00.815686 15121 raft_consensus.cc:2454] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f24bf0fa217d41f99c062f3b1b093af9 in term 1.
I20260811 07:37:00.815721 14579 leader_election.cc:302] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9263cecdd6b34f6bb58292cad21e106f, f24bf0fa217d41f99c062f3b1b093af9; no voters:
I20260811 07:37:00.816016 15224 raft_consensus.cc:2781] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:00.816426 15224 raft_consensus.cc:686] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 LEADER]: Becoming Leader. State: Replica: f24bf0fa217d41f99c062f3b1b093af9, State: Running, Role: LEADER
I20260811 07:37:00.816851 15224 consensus_queue.cc:237] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:00.821398 14460 catalog_manager.cc:5495] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 reported cstate change: term changed from 0 to 1, leader changed from <none> to f24bf0fa217d41f99c062f3b1b093af9 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "f24bf0fa217d41f99c062f3b1b093af9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } health_report { overall_health: HEALTHY } } }
W20260811 07:37:00.829721 15203 tablet.cc:2369] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:00.868963 15248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.863930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38170 (local address 127.22.4.193:39263)
0811 07:37:00.864382 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:00.864390 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:00.864408 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:37:00.864517 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:00.864519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:00.864582 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:00.864714 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:37:00.865151 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.865748 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.866773 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:00.867043 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:00.867136 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:00.867446 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:37:00.867956 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:37:00.868057 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:00.868243 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 07:37:00.868310 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":153,"threads_started":1}
I20260811 07:37:00.875204 14899 raft_consensus.cc:1261] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 1 FOLLOWER]: Refusing update from remote peer f24bf0fa217d41f99c062f3b1b093af9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:00.875267 15121 raft_consensus.cc:1261] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 FOLLOWER]: Refusing update from remote peer f24bf0fa217d41f99c062f3b1b093af9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:00.876310 15237 consensus_queue.cc:1035] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:00.876606 15224 consensus_queue.cc:1035] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:00.888514 15254 mvcc.cc:205] Tried to move back new op lower bound from 7317232930294153216 to 7317232930069966848. Current Snapshot: MvccSnapshot[applied={T|T < 7317232930294153216}]
I20260811 07:37:00.900801 14460 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:00.901137 14460 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50746:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:00.904997 14460 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Sending DeleteTablet for 3 replicas of tablet a5aec410b03e45c9881c94e076920a7b
I20260811 07:37:00.906250 14662 tablet_service.cc:1514] Processing DeleteTablet for tablet a5aec410b03e45c9881c94e076920a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:00 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:38168
I20260811 07:37:00.906384 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 14521
I20260811 07:37:00.906286 15081 tablet_service.cc:1514] Processing DeleteTablet for tablet a5aec410b03e45c9881c94e076920a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:00 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:52588
I20260811 07:37:00.906371 14883 tablet_service.cc:1514] Processing DeleteTablet for tablet a5aec410b03e45c9881c94e076920a7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:00 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:46976
I20260811 07:37:00.918006 15264 tablet_replica.cc:330] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: stopping tablet replica
I20260811 07:37:00.918520 15264 raft_consensus.cc:2229] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:00.918946 15264 raft_consensus.cc:2258] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:00.919878 15265 tablet_replica.cc:330] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: stopping tablet replica
I20260811 07:37:00.920439 15265 raft_consensus.cc:2229] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:00.920939 15265 raft_consensus.cc:2258] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:00.921730 15264 ts_tablet_manager.cc:1905] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:00.923053 15265 ts_tablet_manager.cc:1905] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:00.925100 15264 ts_tablet_manager.cc:1918] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:00.925272 15264 log.cc:1196] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/a5aec410b03e45c9881c94e076920a7b
I20260811 07:37:00.925647 15264 ts_tablet_manager.cc:1939] T a5aec410b03e45c9881c94e076920a7b P 9263cecdd6b34f6bb58292cad21e106f: Deleting consensus metadata
I20260811 07:37:00.926492 15265 ts_tablet_manager.cc:1918] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:00.926635 15265 log.cc:1196] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/a5aec410b03e45c9881c94e076920a7b
I20260811 07:37:00.927140 15265 ts_tablet_manager.cc:1939] T a5aec410b03e45c9881c94e076920a7b P 2ef7a82f624f4fdfa79e8377fbeaa63d: Deleting consensus metadata
I20260811 07:37:00.927574 14434 catalog_manager.cc:4841] TS 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871): tablet a5aec410b03e45c9881c94e076920a7b (table test-table [id=ebd6c4ed005a44eab8007a4126576538]) successfully deleted
I20260811 07:37:00.928777 14440 catalog_manager.cc:4841] TS 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681): tablet a5aec410b03e45c9881c94e076920a7b (table test-table [id=ebd6c4ed005a44eab8007a4126576538]) successfully deleted
W20260811 07:37:00.928807 14437 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:39263 (error 108)
I20260811 07:37:00.929576 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 14769
I20260811 07:37:00.941565 15215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:00.930199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:39263 (local address 127.0.0.1:38184)
0811 07:37:00.941175 (+ 10976us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:00.941372 (+ 197us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:39263: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":10745}
W20260811 07:37:00.942157 14437 catalog_manager.cc:4584] TS f24bf0fa217d41f99c062f3b1b093af9 (127.22.4.193:39263): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a5aec410b03e45c9881c94e076920a7b: Network error: Client connection negotiation failed: client connection to 127.22.4.193:39263: connect: Connection refused (error 111)
I20260811 07:37:00.950013 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 14987
I20260811 07:37:00.977905 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 14399
I20260811 07:37:20.998898 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34955
--webserver_interface=127.22.4.254
--webserver_port=37983
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34955
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:21.164633 15269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:21.165102 15269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:21.165156 15269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:21.169878 15269 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 07:37:21.169986 15269 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 07:37:21.170003 15269 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 07:37:21.170018 15269 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:21.170039 15269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:21.170059 15269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:21.170076 15269 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:21.170094 15269 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:21.180459 15269 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34955
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34955
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=37983
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:21.182221 15269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:21.183882 15269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:37:21.200265 15269 server_base.cc:1034] running on GCE node
W20260811 07:37:21.200189 15284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:21.200179 15275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:21.200158 15276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:21.201689 15269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:21.203547 15269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:21.204856 15269 hybrid_clock.cc:648] HybridClock initialized: now 1786433841204796 us; error 75 us; skew 500 ppm
Aug 11 07:37:21 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:21.215791 15269 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:37:21.218696 15269 webserver.cc:460] Webserver started at http://127.22.4.254:37983/ using document root <none> and password file <none>
I20260811 07:37:21.219766 15269 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:21.219935 15269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:21.226271 15269 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260811 07:37:21.230141 15298 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:21.232415 15269 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260811 07:37:21.232758 15269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "641d1dc29e46470591b9fa67bae8dc07"
format_stamp: "Formatted at 2026-08-11 07:36:37 on dist-test-slave-7z32"
server_key: "519c361d54fc88c0273a0b29d8970c6e"
server_key_iv: "c872d967db1b752fd0f2e4ff2d87efa7"
server_key_version: "encryptionkey@0"
I20260811 07:37:21.233726 15269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:21.257794 15269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:21.263046 15269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:21.263391 15269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:21.275627 15269 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:34955
I20260811 07:37:21.276103 15377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:34955 every 8 connection(s)
I20260811 07:37:21.277529 15269 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:21.284093 15378 sys_catalog.cc:263] Verifying existing consensus state
I20260811 07:37:21.284230 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 15269
I20260811 07:37:21.284883 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:39263
--local_ip_for_outbound_sockets=127.22.4.193
--tserver_master_addrs=127.22.4.254:34955
--webserver_port=41029
--webserver_interface=127.22.4.193
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:37:21.287693 15378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Bootstrap starting.
I20260811 07:37:21.311270 15378 log.cc:824] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:21.324512 15378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:37:21.325063 15378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: Bootstrap complete.
I20260811 07:37:21.329932 15378 raft_consensus.cc:348] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:37:21.330468 15378 raft_consensus.cc:729] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 641d1dc29e46470591b9fa67bae8dc07, State: Initialized, Role: FOLLOWER
I20260811 07:37:21.331168 15378 consensus_queue.cc:260] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:37:21.331367 15378 raft_consensus.cc:388] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:21.331467 15378 raft_consensus.cc:482] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:21.331609 15378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 2 FOLLOWER]: Advancing to term 3
I20260811 07:37:21.334183 15378 raft_consensus.cc:504] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:37:21.334631 15378 leader_election.cc:302] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 641d1dc29e46470591b9fa67bae8dc07; no voters:
I20260811 07:37:21.335110 15378 leader_election.cc:288] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 07:37:21.335248 15385 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 07:37:21.335471 15385 raft_consensus.cc:686] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [term 3 LEADER]: Becoming Leader. State: Replica: 641d1dc29e46470591b9fa67bae8dc07, State: Running, Role: LEADER
I20260811 07:37:21.335976 15385 consensus_queue.cc:237] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } }
I20260811 07:37:21.336763 15378 sys_catalog.cc:564] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:21.337926 15387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "641d1dc29e46470591b9fa67bae8dc07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } } }
I20260811 07:37:21.338186 15387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:21.338920 15388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 641d1dc29e46470591b9fa67bae8dc07. Latest consensus state: current_term: 3 leader_uuid: "641d1dc29e46470591b9fa67bae8dc07" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "641d1dc29e46470591b9fa67bae8dc07" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34955 } } }
I20260811 07:37:21.339244 15388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:21.344405 15411 catalog_manager.cc:1259] Loaded cluster ID: 5306f168cc97429d98d52ee9f9a1cdcf
I20260811 07:37:21.344532 15411 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: loading cluster ID for follower catalog manager: success
I20260811 07:37:21.347996 15411 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 641d1dc29e46470591b9fa67bae8dc07: acquiring CA information for follower catalog manager: success
F20260811 07:37:21.349846 15411 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f6c8048c9ad google::LogMessage::Fail() at ??:0
@ 0x7f6c8048f88a google::LogMessage::SendToLog() at ??:0
@ 0x7f6c8048c4de google::LogMessage::Flush() at ??:0
@ 0x7f6c8048da19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f6c8315018d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f6c8adf1989 kudu::master::CatalogManager::LoadTspkEntries() at ??:0
@ 0x7f6c8adce023 kudu::master::CatalogManager::PrepareFollowerTokenVerifier() at ??:0
@ 0x7f6c8adce54b kudu::master::CatalogManager::PrepareFollower() at ??:0
@ 0x7f6c8adc7652 kudu::master::CatalogManagerBgTasks::Run() at ??:0
@ 0x7f6c8adc69e9 _ZZN4kudu6master21CatalogManagerBgTasks4InitEvENKUlvE_clEv at ??:0
@ 0x7f6c8ae0d541 _ZNSt17_Function_handlerIFvvEZN4kudu6master21CatalogManagerBgTasks4InitEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f6c826cf512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6c83d136db start_thread at ??:0
@ 0x7f6c7ef8a61f clone at ??:0
W20260811 07:37:21.503221 15380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:21.503738 15380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:21.503809 15380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:21.509888 15380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:21.510035 15380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:21.510172 15380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:37:21.518491 15380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:39263
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=41029
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:21.520525 15380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:21.522887 15380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:21.541188 15447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:21.541198 15444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:21.541379 15443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:21.543188 15380 server_base.cc:1034] running on GCE node
I20260811 07:37:21.544060 15380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:21.545531 15380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:21.553448 15380 hybrid_clock.cc:648] HybridClock initialized: now 1786433841553174 us; error 249 us; skew 500 ppm
Aug 11 07:37:21 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:21.559325 15380 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:37:21.561439 15380 webserver.cc:460] Webserver started at http://127.22.4.193:41029/ using document root <none> and password file <none>
I20260811 07:37:21.563082 15380 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:21.563267 15380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:21.572232 15380 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:37:21.576524 15457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:21.579490 15380 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:37:21.579763 15380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "f24bf0fa217d41f99c062f3b1b093af9"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "66f800fc51ae3ad4c0661af2dd565754"
server_key_iv: "860e88278c1f64908b9bf94a6d411117"
server_key_version: "encryptionkey@0"
I20260811 07:37:21.581070 15380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:21.599651 15380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:21.605192 15380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:21.605554 15380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:21.606678 15380 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:21.608757 15474 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 07:37:21.616782 15380 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 07:37:21.616923 15380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.009s user 0.001s sys 0.000s
I20260811 07:37:21.617003 15380 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 07:37:21.620711 15380 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 07:37:21.620836 15380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.004s user 0.002s sys 0.000s
I20260811 07:37:21.621254 15474 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Bootstrap starting.
I20260811 07:37:21.639201 15380 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:39263
I20260811 07:37:21.639979 15646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:39263 every 8 connection(s)
I20260811 07:37:21.641376 15380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
W20260811 07:37:21.647964 15651 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:37:21.645554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:49525)
0811 07:37:21.646621 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:21.646816 (+ 195us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":654,"thread_start_us":316,"threads_started":1}
W20260811 07:37:21.648761 15647 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:34955 (0 consecutive failures): Network error: Failed to ping master at 127.22.4.254:34955: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection reset by peer (error 104)
I20260811 07:37:21.650112 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:21.649610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:41623)
0811 07:37:21.649860 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:21.649951 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260811 07:37:21.651330 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:21.650893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:58103)
0811 07:37:21.651085 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:21.651168 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 07:37:21.651721 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 15380
W20260811 07:37:21.651736 15647 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:37:21.652230 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:39871
--local_ip_for_outbound_sockets=127.22.4.194
--tserver_master_addrs=127.22.4.254:34955
--webserver_port=39351
--webserver_interface=127.22.4.194
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:37:21.653403 15474 log.cc:824] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:21.664459 15474 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 07:37:21.665117 15474 tablet_bootstrap.cc:492] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Bootstrap complete.
I20260811 07:37:21.666786 15474 ts_tablet_manager.cc:1397] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Time spent bootstrapping tablet: real 0.046s user 0.025s sys 0.017s
I20260811 07:37:21.670560 15474 raft_consensus.cc:348] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:21.671258 15474 raft_consensus.cc:729] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f24bf0fa217d41f99c062f3b1b093af9, State: Initialized, Role: FOLLOWER
I20260811 07:37:21.671861 15474 consensus_queue.cc:260] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:21.673169 15474 ts_tablet_manager.cc:1428] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
I20260811 07:37:21.673935 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:21.673513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:48531)
0811 07:37:21.673741 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:21.673839 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260811 07:37:21.675117 15651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:21.674674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:39709)
0811 07:37:21.674968 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:21.675040 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260811 07:37:21.818216 15654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:21.818673 15654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:21.818732 15654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:21.823810 15654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:21.823921 15654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:21.823999 15654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:37:21.830704 15654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:39871
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=39351
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:21.832433 15654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:21.834049 15654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:21.849057 15663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:21.849318 15664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:21.849318 15670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:21.849767 15654 server_base.cc:1034] running on GCE node
I20260811 07:37:21.850498 15654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:21.851789 15654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:21.855305 15654 hybrid_clock.cc:648] HybridClock initialized: now 1786433841855197 us; error 93 us; skew 500 ppm
Aug 11 07:37:21 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:21.860477 15654 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:37:21.862123 15654 webserver.cc:460] Webserver started at http://127.22.4.194:39351/ using document root <none> and password file <none>
I20260811 07:37:21.863174 15654 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:21.863310 15654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:21.869424 15654 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s
I20260811 07:37:21.873456 15678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:21.876121 15654 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 07:37:21.876421 15654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "9263cecdd6b34f6bb58292cad21e106f"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "20656f614680789dab00699f8dac2150"
server_key_iv: "5332286a6bc7986a874d9b0863b5ddb7"
server_key_version: "encryptionkey@0"
I20260811 07:37:21.877378 15654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:21.917670 15654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:21.922623 15654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:21.922983 15654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:21.923918 15654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:21.925149 15654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:21.925235 15654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:21.925325 15654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:21.925372 15654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:21.939431 15654 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:39871
I20260811 07:37:21.939653 15872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:39871 every 8 connection(s)
I20260811 07:37:21.941022 15654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:37:21.946240 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 15654
I20260811 07:37:21.946916 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:43681
--local_ip_for_outbound_sockets=127.22.4.195
--tserver_master_addrs=127.22.4.254:34955
--webserver_port=35233
--webserver_interface=127.22.4.195
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:37:21.947580 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:21.944776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:58451)
0811 07:37:21.946008 (+ 1232us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:21.946246 (+ 238us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":754,"thread_start_us":181,"threads_started":1}
W20260811 07:37:21.948498 15873 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:34955 (0 consecutive failures): Network error: Failed to ping master at 127.22.4.254:34955: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
I20260811 07:37:21.950069 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:21.949396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:53835)
0811 07:37:21.949808 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:21.949917 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":247}
I20260811 07:37:21.951284 15876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:21.950921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:42259)
0811 07:37:21.951101 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:21.951182 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260811 07:37:21.951632 15873 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 07:37:22.118286 15878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:22.118925 15878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:22.119097 15878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:22.124994 15878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:22.125183 15878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:22.125327 15878 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:37:22.133114 15878 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:43681
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=35233
--tserver_master_addrs=127.22.4.254:34955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:22.135411 15878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:22.137158 15878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:22.152951 15886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:22.152885 15890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:22.153105 15878 server_base.cc:1034] running on GCE node
W20260811 07:37:22.153007 15887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:22.153909 15878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:22.154906 15878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:22.156105 15878 hybrid_clock.cc:648] HybridClock initialized: now 1786433842156073 us; error 59 us; skew 500 ppm
Aug 11 07:37:22 dist-test-slave-7z32 krb5kdc[13506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433842, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:22.160451 15878 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:37:22.161741 15878 webserver.cc:460] Webserver started at http://127.22.4.195:35233/ using document root <none> and password file <none>
I20260811 07:37:22.162487 15878 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:22.162565 15878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:22.168432 15878 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:37:22.171731 15897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:22.174494 15878 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:37:22.174779 15878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d"
format_stamp: "Formatted at 2026-08-11 07:36:38 on dist-test-slave-7z32"
server_key: "476afae71402c966526668548e47020c"
server_key_iv: "8da170e6b5025eb8e2e7f692cc168394"
server_key_version: "encryptionkey@0"
I20260811 07:37:22.175693 15878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:22.208457 15878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:22.214236 15878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:22.214584 15878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:22.215642 15878 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:22.216881 15878 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:22.216946 15878 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:22.217028 15878 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:22.217072 15878 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:22.229637 15878 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:43681
I20260811 07:37:22.229941 16090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:43681 every 8 connection(s)
I20260811 07:37:22.231125 15878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:37:22.231791 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 15878
I20260811 07:37:22.237095 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.234558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:57333)
0811 07:37:22.235780 (+ 1222us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:22.235966 (+ 186us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":876,"thread_start_us":276,"threads_started":1}
W20260811 07:37:22.237874 16091 heartbeater.cc:644] Failed to heartbeat to 127.22.4.254:34955 (0 consecutive failures): Network error: Failed to ping master at 127.22.4.254:34955: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
I20260811 07:37:22.238811 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.238505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:37791)
0811 07:37:22.238664 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:22.238739 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260811 07:37:22.239671 16096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.239446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:33855)
0811 07:37:22.239573 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:22.239620 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260811 07:37:22.239909 16091 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 07:37:22.677189 16098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.676478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:50977)
0811 07:37:22.676918 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:22.677033 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":139,"threads_started":1}
I20260811 07:37:22.820947 16099 raft_consensus.cc:482] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:22.821192 16099 raft_consensus.cc:504] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:22.822793 16099 leader_election.cc:288] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681), 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
Aug 11 07:37:22 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.194@KRBTEST.COM
Aug 11 07:37:22 dist-test-slave-7z32 krb5kdc[13506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433841, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.195@KRBTEST.COM
I20260811 07:37:22.842392 16105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.823549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:59603 (local address 127.22.4.195:43681)
0811 07:37:22.823996 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:22.824011 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:22.824151 (+ 140us) server_negotiation.cc:407] Connection header received
0811 07:37:22.825638 (+ 1487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:22.825646 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:22.826066 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:22.826402 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:22.828170 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:22.829652 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:22.831282 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:22.831837 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:22.832050 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:22.836259 (+ 4209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:22.836268 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:22.836286 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:22.836335 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:22.838656 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:22.839500 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:22.839507 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:22.839513 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:22.839712 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:22.840163 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:22.840169 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:22.840171 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:22.840989 (+ 818us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:22.841188 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:22.841801 (+ 613us) server_negotiation.cc:299] Negotiation successful
0811 07:37:22.842144 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":109,"threads_started":1}
I20260811 07:37:22.842373 16098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.823296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:43681 (local address 127.22.4.193:59603)
0811 07:37:22.823981 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:22.824001 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:22.824597 (+ 596us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:22.826533 (+ 1936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:22.826542 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:22.827300 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:22.827930 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:22.827955 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:22.829834 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:22.829838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:22.831113 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:22.831127 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:22.832005 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:22.832010 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:22.832298 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:22.833177 (+ 879us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:22.833192 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:22.835837 (+ 2645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:22.838979 (+ 3142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:22.838985 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:22.838988 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:22.839318 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:22.839858 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:22.839865 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:22.839870 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:22.839975 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:22.841136 (+ 1161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:22.841139 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:22.841403 (+ 264us) client_negotiation.cc:769] Sending connection context
0811 07:37:22.841641 (+ 238us) client_negotiation.cc:240] Negotiation successful
0811 07:37:22.842163 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"mutex_wait_us":170,"spinlock_wait_cycles":48768,"thread_start_us":216,"threads_started":1}
I20260811 07:37:22.842566 16103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.823495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:36427 (local address 127.22.4.194:39871)
0811 07:37:22.824058 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:22.824080 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:22.824142 (+ 62us) server_negotiation.cc:407] Connection header received
0811 07:37:22.825647 (+ 1505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:22.825655 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:22.826075 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:22.826461 (+ 386us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:22.828170 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:22.829693 (+ 1523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:22.831282 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:22.831834 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:22.832050 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:22.835946 (+ 3896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:22.835959 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:22.835991 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:22.836048 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:22.838444 (+ 2396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:22.839296 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:22.839303 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:22.839307 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:22.839460 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:22.839985 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:22.839990 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:22.839992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:22.840844 (+ 852us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:22.841050 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:22.841837 (+ 787us) server_negotiation.cc:299] Negotiation successful
0811 07:37:22.842238 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":125,"threads_started":1}
I20260811 07:37:22.843014 16101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.823240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:39871 (local address 127.22.4.193:36427)
0811 07:37:22.823807 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:22.823845 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:22.824569 (+ 724us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:22.826529 (+ 1960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:22.826540 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:22.827290 (+ 750us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:22.827930 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:22.827952 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:22.829893 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:22.829897 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:22.831120 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:22.831137 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:22.832000 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:22.832004 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:22.832293 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:22.833127 (+ 834us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:22.833163 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:22.835535 (+ 2372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:22.838626 (+ 3091us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:22.838634 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:22.838654 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:22.839125 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:22.839580 (+ 455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:22.839584 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:22.839586 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:22.839810 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:22.841083 (+ 1273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:22.841093 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:22.841405 (+ 312us) client_negotiation.cc:769] Sending connection context
0811 07:37:22.841642 (+ 237us) client_negotiation.cc:240] Negotiation successful
0811 07:37:22.842304 (+ 662us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":328,"spinlock_wait_cycles":74880}
W20260811 07:37:22.846473 15461 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
W20260811 07:37:22.846745 15471 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
I20260811 07:37:22.846872 15471 leader_election.cc:302] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24bf0fa217d41f99c062f3b1b093af9; no voters: 2ef7a82f624f4fdfa79e8377fbeaa63d, 9263cecdd6b34f6bb58292cad21e106f
I20260811 07:37:22.847249 16099 raft_consensus.cc:2726] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:37:22.953274 16106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:22.952469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:55351)
0811 07:37:22.952982 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:22.953094 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":105,"threads_started":1}
I20260811 07:37:23.241726 16107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:23.240882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:50917)
0811 07:37:23.241395 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:23.241491 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":230,"threads_started":1}
I20260811 07:37:23.679320 16108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:23.678505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:59331)
0811 07:37:23.679028 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:23.679169 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":122,"threads_started":1}
I20260811 07:37:23.955417 16109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:23.954494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:47805)
0811 07:37:23.955118 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:23.955228 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":100,"threads_started":1}
I20260811 07:37:24.243953 16111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:24.243221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:37637)
0811 07:37:24.243692 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:24.243798 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":127,"threads_started":1}
I20260811 07:37:24.681371 16112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:24.680615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:46839)
0811 07:37:24.681116 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:24.681235 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":161,"threads_started":1}
I20260811 07:37:24.696439 16113 raft_consensus.cc:482] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:24.696661 16113 raft_consensus.cc:504] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:24.697206 16113 leader_election.cc:288] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681), 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
W20260811 07:37:24.698659 15461 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
W20260811 07:37:24.698767 15471 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
I20260811 07:37:24.698815 15461 leader_election.cc:302] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24bf0fa217d41f99c062f3b1b093af9; no voters: 2ef7a82f624f4fdfa79e8377fbeaa63d, 9263cecdd6b34f6bb58292cad21e106f
I20260811 07:37:24.699082 16113 raft_consensus.cc:2726] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:37:24.957588 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:24.956873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:36915)
0811 07:37:24.957352 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:24.957452 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":126,"threads_started":1}
I20260811 07:37:25.245888 16119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:25.245092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:55053)
0811 07:37:25.245563 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:25.245726 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":126,"threads_started":1}
I20260811 07:37:25.683465 16120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:25.682521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:36939)
0811 07:37:25.683260 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:25.683340 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":175,"threads_started":1}
I20260811 07:37:25.959731 16121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:25.958935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:51057)
0811 07:37:25.959442 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:25.959573 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":99,"threads_started":1}
I20260811 07:37:26.248160 16122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:26.247414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:54035)
0811 07:37:26.247918 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:26.248022 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":132,"threads_started":1}
I20260811 07:37:26.685566 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:26.684928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:39549)
0811 07:37:26.685321 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:26.685416 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":98,"threads_started":1}
I20260811 07:37:26.962069 16129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:26.961314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:34353)
0811 07:37:26.961803 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:26.961907 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":129,"threads_started":1}
I20260811 07:37:27.250552 16130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:27.249728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:33041)
0811 07:37:27.250298 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:27.250407 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":227,"threads_started":1}
I20260811 07:37:27.308794 16134 raft_consensus.cc:482] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:27.309020 16134 raft_consensus.cc:504] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:27.309542 16134 leader_election.cc:288] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681), 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
W20260811 07:37:27.311324 15471 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
W20260811 07:37:27.311568 15461 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
I20260811 07:37:27.311728 15461 leader_election.cc:302] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24bf0fa217d41f99c062f3b1b093af9; no voters: 2ef7a82f624f4fdfa79e8377fbeaa63d, 9263cecdd6b34f6bb58292cad21e106f
I20260811 07:37:27.312058 16134 raft_consensus.cc:2726] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:37:27.687788 16138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:27.687102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:33853)
0811 07:37:27.687514 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:27.687625 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":109,"threads_started":1}
I20260811 07:37:27.964321 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:27.963597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:59809)
0811 07:37:27.964053 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:27.964156 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":105,"threads_started":1}
I20260811 07:37:28.252576 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:28.251900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:35557)
0811 07:37:28.252358 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:28.252450 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":139,"threads_started":1}
I20260811 07:37:28.690166 16143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:28.689447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:56971)
0811 07:37:28.689942 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:28.690043 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":156,"threads_started":1}
I20260811 07:37:28.966185 16144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:28.965469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:46131)
0811 07:37:28.965969 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:28.966057 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":125,"threads_started":1}
I20260811 07:37:29.255113 16146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:29.254138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:53587)
0811 07:37:29.254757 (+ 619us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:29.254958 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":139,"threads_started":1}
I20260811 07:37:29.692307 16147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:29.691552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:57779)
0811 07:37:29.692064 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:29.692162 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":138,"threads_started":1}
I20260811 07:37:29.968427 16148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:29.967741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:34557)
0811 07:37:29.968204 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:29.968298 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":141,"threads_started":1}
I20260811 07:37:30.257124 16149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:30.256409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:42835)
0811 07:37:30.256853 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:30.256944 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":93,"threads_started":1}
I20260811 07:37:30.694478 16151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:30.693757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:37259)
0811 07:37:30.694266 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:30.694357 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":373,"thread_start_us":153,"threads_started":1}
I20260811 07:37:30.970701 16153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:30.969920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:44551)
0811 07:37:30.970361 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:30.970458 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":111,"threads_started":1}
I20260811 07:37:31.259428 16154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:31.258453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:49477)
0811 07:37:31.259164 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:31.259294 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":125,"threads_started":1}
I20260811 07:37:31.363377 16155 raft_consensus.cc:482] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:31.363587 16155 raft_consensus.cc:504] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:31.364241 16155 leader_election.cc:288] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681), 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
W20260811 07:37:31.365571 15461 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
W20260811 07:37:31.365803 15471 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
I20260811 07:37:31.365949 15471 leader_election.cc:302] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24bf0fa217d41f99c062f3b1b093af9; no voters: 2ef7a82f624f4fdfa79e8377fbeaa63d, 9263cecdd6b34f6bb58292cad21e106f
I20260811 07:37:31.366158 16155 raft_consensus.cc:2726] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:37:31.696882 16157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:31.696011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:51433)
0811 07:37:31.696491 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:31.696732 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":125,"threads_started":1}
I20260811 07:37:31.972867 16158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:31.972158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:43827)
0811 07:37:31.972647 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:31.972740 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":123,"threads_started":1}
I20260811 07:37:32.261685 16159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:32.260979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:50409)
0811 07:37:32.261352 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:32.261532 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":144,"threads_started":1}
I20260811 07:37:32.698964 16160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:32.698230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:54573)
0811 07:37:32.698677 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:32.698766 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":111,"threads_started":1}
I20260811 07:37:32.975019 16161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:32.974256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:43959)
0811 07:37:32.974715 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:32.974805 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":148,"threads_started":1}
I20260811 07:37:33.264328 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:33.263360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:38889)
0811 07:37:33.264034 (+ 674us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:33.264131 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":442,"threads_started":1}
I20260811 07:37:33.701082 16163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:33.700208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:41809)
0811 07:37:33.700793 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:33.700901 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":186,"threads_started":1}
I20260811 07:37:33.977085 16164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:33.976408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:59649)
0811 07:37:33.976790 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:33.976910 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":149,"threads_started":1}
I20260811 07:37:34.266396 16165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:34.265640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:36353)
0811 07:37:34.266118 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:34.266223 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":106,"threads_started":1}
I20260811 07:37:34.703691 16166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:34.702699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:38649)
0811 07:37:34.703311 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:34.703450 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":228,"threads_started":1}
I20260811 07:37:34.979107 16168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:34.978368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:39507)
0811 07:37:34.978773 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:34.978979 (+ 206us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":125,"threads_started":1}
I20260811 07:37:35.268445 16169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:35.267813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:40069)
0811 07:37:35.268226 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:35.268320 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":136,"threads_started":1}
I20260811 07:37:35.705906 16172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:35.705108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:42023)
0811 07:37:35.705582 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:35.705755 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":95,"threads_started":1}
I20260811 07:37:35.980995 16175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:35.980205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:52403)
0811 07:37:35.980719 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:35.980841 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":162,"threads_started":1}
I20260811 07:37:36.226177 16177 raft_consensus.cc:482] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:36.226439 16177 raft_consensus.cc:504] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ef7a82f624f4fdfa79e8377fbeaa63d" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 43681 } } peers { permanent_uuid: "9263cecdd6b34f6bb58292cad21e106f" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 39871 } } peers { permanent_uuid: "f24bf0fa217d41f99c062f3b1b093af9" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 39263 } }
I20260811 07:37:36.227460 16177 leader_election.cc:288] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681), 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871)
W20260811 07:37:36.228557 15461 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9263cecdd6b34f6bb58292cad21e106f (127.22.4.194:39871): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
W20260811 07:37:36.228737 15471 leader_election.cc:341] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2ef7a82f624f4fdfa79e8377fbeaa63d (127.22.4.195:43681): Not found: Tablet not found: a5aec410b03e45c9881c94e076920a7b
I20260811 07:37:36.228892 15471 leader_election.cc:302] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f24bf0fa217d41f99c062f3b1b093af9; no voters: 2ef7a82f624f4fdfa79e8377fbeaa63d, 9263cecdd6b34f6bb58292cad21e106f
I20260811 07:37:36.229162 16177 raft_consensus.cc:2726] T a5aec410b03e45c9881c94e076920a7b P f24bf0fa217d41f99c062f3b1b093af9 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 07:37:36.270483 16178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:36.269802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:57077)
0811 07:37:36.270243 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:36.270335 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":124,"threads_started":1}
I20260811 07:37:36.709014 16179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:36.708257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.193:59177)
0811 07:37:36.708699 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:36.708864 (+ 165us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":120,"threads_started":1}
I20260811 07:37:36.983990 16180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:36.983140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.194:32977)
0811 07:37:36.983730 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:36.983803 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":152,"threads_started":1}
I20260811 07:37:37.243296 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 15380
I20260811 07:37:37.256058 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 15654
I20260811 07:37:37.274994 16186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:37.272489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34955 (local address 127.22.4.195:40813)
0811 07:37:37.274642 (+ 2153us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:37.274771 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.254:34955: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1995,"thread_start_us":1630,"threads_started":1}
I20260811 07:37:37.281739 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 15878
2026-08-11T07:37:37Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (61281 ms)
[----------] 30 tests from SecurityITest (327884 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:37:37 dist-test-slave-7z32 krb5kdc[16190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:37:37 dist-test-slave-7z32 krb5kdc[16190](info): set up 2 sockets
Aug 11 07:37:37 dist-test-slave-7z32 krb5kdc[16190](info): commencing operation
krb5kdc: starting...
W20260811 07:37:38.768940 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.447s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:37:38 dist-test-slave-7z32 krb5kdc[16190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:37:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:37:38.994867 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42339
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:42385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:42339
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:39.203717 16214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:39.204453 16214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:39.204845 16214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:39.213914 16214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:39.214157 16214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:39.214231 16214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:39.214344 16214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:39.214375 16214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:39.226092 16214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:42385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:42339
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42339
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:39.228293 16214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:39.230444 16214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:39.249920 16225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:39.249940 16221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:39.250095 16214 server_base.cc:1034] running on GCE node
W20260811 07:37:39.249940 16222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:39.252101 16214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:39.256181 16214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:39.259894 16214 hybrid_clock.cc:648] HybridClock initialized: now 1786433859259724 us; error 193 us; skew 500 ppm
Aug 11 07:37:39 dist-test-slave-7z32 krb5kdc[16190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:39.267951 16214 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:37:39.269552 16214 webserver.cc:460] Webserver started at http://127.22.4.254:40413/ using document root <none> and password file <none>
I20260811 07:37:39.270398 16214 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:39.270499 16214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:39.270955 16214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:39.276081 16214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "2911ad6bc0d5462396fea40db6d5d2a0"
format_stamp: "Formatted at 2026-08-11 07:37:39 on dist-test-slave-7z32"
server_key: "04c0bd2a631f1e2aa6aac3d379a81d89"
server_key_iv: "ae0874646996ac7ac985a9d606f78239"
server_key_version: "encryptionkey@0"
I20260811 07:37:39.278591 16214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "2911ad6bc0d5462396fea40db6d5d2a0"
format_stamp: "Formatted at 2026-08-11 07:37:39 on dist-test-slave-7z32"
server_key: "04c0bd2a631f1e2aa6aac3d379a81d89"
server_key_iv: "ae0874646996ac7ac985a9d606f78239"
server_key_version: "encryptionkey@0"
I20260811 07:37:39.292403 16214 fs_manager.cc:691] Time spent creating directory manager: real 0.012s user 0.010s sys 0.001s
I20260811 07:37:39.298486 16246 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:39.301403 16214 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.001s
I20260811 07:37:39.301759 16214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "2911ad6bc0d5462396fea40db6d5d2a0"
format_stamp: "Formatted at 2026-08-11 07:37:39 on dist-test-slave-7z32"
server_key: "04c0bd2a631f1e2aa6aac3d379a81d89"
server_key_iv: "ae0874646996ac7ac985a9d606f78239"
server_key_version: "encryptionkey@0"
I20260811 07:37:39.302039 16214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:39.323685 16214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:39.329703 16214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:39.330034 16214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:39.342504 16214 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:42339
I20260811 07:37:39.342587 16343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:42339 every 8 connection(s)
I20260811 07:37:39.344005 16214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:39.346488 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 16214
I20260811 07:37:39.346908 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:39.347401 22547 external_mini_cluster.cc:1428] Setting key 2eea9700493534008c80e9f9538237a3
I20260811 07:37:39.349567 16345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:39.359298 16345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0: Bootstrap starting.
Aug 11 07:37:39 dist-test-slave-7z32 krb5kdc[16190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:39.363408 16345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:39.364538 16345 log.cc:824] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:39.368974 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:39.349399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41596 (local address 127.22.4.254:42339)
0811 07:37:39.350283 (+ 884us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:39.350307 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:39.350373 (+ 66us) server_negotiation.cc:407] Connection header received
0811 07:37:39.351371 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:39.351398 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:39.351872 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:39.352308 (+ 436us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:39.353303 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:39.354561 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:39.355757 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:39.356367 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:39.356657 (+ 290us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:39.361016 (+ 4359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:39.361024 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:39.361045 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:39.361094 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:39.363912 (+ 2818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:39.365062 (+ 1150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:39.365077 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:39.365085 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:39.365313 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:39.365757 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:39.365761 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:39.365764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:39.366522 (+ 758us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:39.366790 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:39.367195 (+ 405us) server_negotiation.cc:299] Negotiation successful
0811 07:37:39.367606 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":340,"threads_started":1}
I20260811 07:37:39.369060 16345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0: No bootstrap required, opened a new log
I20260811 07:37:39.374709 16345 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911ad6bc0d5462396fea40db6d5d2a0" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42339 } }
I20260811 07:37:39.375252 16345 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:39.375331 16345 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2911ad6bc0d5462396fea40db6d5d2a0, State: Initialized, Role: FOLLOWER
I20260811 07:37:39.375932 16345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911ad6bc0d5462396fea40db6d5d2a0" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42339 } }
I20260811 07:37:39.376133 16345 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:39.376241 16345 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:39.376398 16345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:39.377961 16345 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911ad6bc0d5462396fea40db6d5d2a0" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42339 } }
I20260811 07:37:39.378577 16345 leader_election.cc:302] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2911ad6bc0d5462396fea40db6d5d2a0; no voters:
I20260811 07:37:39.379175 16345 leader_election.cc:288] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:39.379635 16351 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:39.380226 16351 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [term 1 LEADER]: Becoming Leader. State: Replica: 2911ad6bc0d5462396fea40db6d5d2a0, State: Running, Role: LEADER
I20260811 07:37:39.381227 16345 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:39.381165 16351 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911ad6bc0d5462396fea40db6d5d2a0" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42339 } }
I20260811 07:37:39.383657 16355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2911ad6bc0d5462396fea40db6d5d2a0. Latest consensus state: current_term: 1 leader_uuid: "2911ad6bc0d5462396fea40db6d5d2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911ad6bc0d5462396fea40db6d5d2a0" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42339 } } }
I20260811 07:37:39.383873 16355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:39.384286 16352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2911ad6bc0d5462396fea40db6d5d2a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2911ad6bc0d5462396fea40db6d5d2a0" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42339 } } }
I20260811 07:37:39.384888 16352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0 [sys.catalog]: This master's current role is: LEADER
W20260811 07:37:39.388494 16379 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:37:39.388646 16379 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:37:39.388814 16380 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:39.390200 16380 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:39.399922 16380 catalog_manager.cc:1347] Generated new cluster ID: 6a1cba674160481eb62b48aa5327c12c
I20260811 07:37:39.400378 16380 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:39.419955 16380 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:39.421865 16380 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:39.430868 16380 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0: Generated new TSK 0
I20260811 07:37:39.431981 16380 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:37:39.502588 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42339
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:42385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:39.683072 16391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:39.683465 16391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:39.683516 16391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:39.688084 16391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:39.688181 16391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:39.688249 16391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:37:39.695863 16391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:42385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:39.697618 16391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:39.699070 16391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:39.713371 16400 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:39.713295 16402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:39.713404 16404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:39.713853 16391 server_base.cc:1034] running on GCE node
I20260811 07:37:39.714434 16391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:39.715353 16391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:39.716616 16391 hybrid_clock.cc:648] HybridClock initialized: now 1786433859716596 us; error 62 us; skew 500 ppm
Aug 11 07:37:39 dist-test-slave-7z32 krb5kdc[16190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:39.725425 16391 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:37:39.726934 16391 webserver.cc:460] Webserver started at http://127.22.4.193:42017/ using document root <none> and password file <none>
I20260811 07:37:39.727761 16391 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:39.727846 16391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:39.728085 16391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:39.731000 16391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "5c3f4393d73143688eb95524fdee524a"
format_stamp: "Formatted at 2026-08-11 07:37:39 on dist-test-slave-7z32"
server_key: "f9ca876919d7d7a9039a516583f8bb9f"
server_key_iv: "b3cd98dff9ba330b341177b8acb5433c"
server_key_version: "encryptionkey@0"
I20260811 07:37:39.731735 16391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "5c3f4393d73143688eb95524fdee524a"
format_stamp: "Formatted at 2026-08-11 07:37:39 on dist-test-slave-7z32"
server_key: "f9ca876919d7d7a9039a516583f8bb9f"
server_key_iv: "b3cd98dff9ba330b341177b8acb5433c"
server_key_version: "encryptionkey@0"
I20260811 07:37:39.738472 16391 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260811 07:37:39.742756 16414 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:39.744961 16391 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 07:37:39.745239 16391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "5c3f4393d73143688eb95524fdee524a"
format_stamp: "Formatted at 2026-08-11 07:37:39 on dist-test-slave-7z32"
server_key: "f9ca876919d7d7a9039a516583f8bb9f"
server_key_iv: "b3cd98dff9ba330b341177b8acb5433c"
server_key_version: "encryptionkey@0"
I20260811 07:37:39.745435 16391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:39.766108 16391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:39.770924 16391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:39.771252 16391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:39.772143 16391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:39.773666 16391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:39.773738 16391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:39.773841 16391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:39.773888 16391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:39.790694 16391 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:34693
I20260811 07:37:39.790829 16606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:34693 every 8 connection(s)
I20260811 07:37:39.792393 16391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:37:39.798569 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 16391
I20260811 07:37:39.798759 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:37:39.799237 22547 external_mini_cluster.cc:1428] Setting key d3e0ad4333fdfd8329b07b4fa9d291b5
Aug 11 07:37:39 dist-test-slave-7z32 krb5kdc[16190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433859, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
I20260811 07:37:39.815697 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:39.795571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:48617 (local address 127.22.4.254:42339)
0811 07:37:39.795804 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:39.795811 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:39.797004 (+ 1193us) server_negotiation.cc:407] Connection header received
0811 07:37:39.799045 (+ 2041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:39.799052 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:39.799142 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:39.799292 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:39.801479 (+ 2187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:39.802349 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:39.804200 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:39.804489 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:39.804641 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:39.809238 (+ 4597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:39.809243 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:39.809246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:39.809292 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:39.811370 (+ 2078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:39.812661 (+ 1291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:39.812676 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:39.812678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:39.812829 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:39.813689 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:39.813694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:39.813696 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:39.814037 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:39.814288 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:39.815212 (+ 924us) server_negotiation.cc:299] Negotiation successful
0811 07:37:39.815441 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260811 07:37:39.816587 16611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:39.795916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:42339 (local address 127.22.4.193:48617)
0811 07:37:39.796722 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:39.796801 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:39.798517 (+ 1716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:39.799628 (+ 1111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:39.799716 (+ 88us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:39.800389 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:39.801216 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:39.801244 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:39.802556 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:39.802561 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:39.803931 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:39.803948 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:39.804755 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:39.804760 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:39.804980 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:39.805810 (+ 830us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:39.805833 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:39.808840 (+ 3007us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:39.811647 (+ 2807us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:39.811663 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:39.811696 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:39.812386 (+ 690us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:39.813083 (+ 697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:39.813087 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:39.813090 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:39.813414 (+ 324us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:39.814329 (+ 915us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:39.814339 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:39.814729 (+ 390us) client_negotiation.cc:769] Sending connection context
0811 07:37:39.815037 (+ 308us) client_negotiation.cc:240] Negotiation successful
0811 07:37:39.815450 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":183,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:37:39.819276 16608 heartbeater.cc:347] Connected to a master server at 127.22.4.254:42339
I20260811 07:37:39.819650 16608 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:39.820597 16608 heartbeater.cc:511] Master 127.22.4.254:42339 requested a full tablet report, sending...
I20260811 07:37:39.823326 16279 ts_manager.cc:194] Registered new tserver with Master: 5c3f4393d73143688eb95524fdee524a (127.22.4.193:34693)
I20260811 07:37:39.825196 16279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:48617
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:37:39.845860 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42339
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:42385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:39.991595 16619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:39.991955 16619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:39.992007 16619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:39.998979 16619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:39.999110 16619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:39.999209 16619 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:37:40.008255 16619 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:42385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:40.009637 16619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:40.010793 16619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:40.024297 16628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:40.024194 16630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:40.024194 16626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:40.024746 16619 server_base.cc:1034] running on GCE node
I20260811 07:37:40.025440 16619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:40.026424 16619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:40.027697 16619 hybrid_clock.cc:648] HybridClock initialized: now 1786433860027685 us; error 91 us; skew 500 ppm
Aug 11 07:37:40 dist-test-slave-7z32 krb5kdc[16190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433860, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:40.031903 16619 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:37:40.033399 16619 webserver.cc:460] Webserver started at http://127.22.4.194:45855/ using document root <none> and password file <none>
I20260811 07:37:40.034252 16619 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:40.034336 16619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:40.034606 16619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:40.037645 16619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "1b205d0d37094a64a1e01558fe8d0e38"
format_stamp: "Formatted at 2026-08-11 07:37:40 on dist-test-slave-7z32"
server_key: "0f9c2af321c4af2d94baacd0176e1b3a"
server_key_iv: "68b63813a25717ded8f0f13b9e1e0410"
server_key_version: "encryptionkey@0"
I20260811 07:37:40.038496 16619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "1b205d0d37094a64a1e01558fe8d0e38"
format_stamp: "Formatted at 2026-08-11 07:37:40 on dist-test-slave-7z32"
server_key: "0f9c2af321c4af2d94baacd0176e1b3a"
server_key_iv: "68b63813a25717ded8f0f13b9e1e0410"
server_key_version: "encryptionkey@0"
I20260811 07:37:40.044392 16619 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:37:40.048673 16645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:40.050954 16619 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.004s
I20260811 07:37:40.051213 16619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "1b205d0d37094a64a1e01558fe8d0e38"
format_stamp: "Formatted at 2026-08-11 07:37:40 on dist-test-slave-7z32"
server_key: "0f9c2af321c4af2d94baacd0176e1b3a"
server_key_iv: "68b63813a25717ded8f0f13b9e1e0410"
server_key_version: "encryptionkey@0"
I20260811 07:37:40.051467 16619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:40.075426 16619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:40.081447 16619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:40.081773 16619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:40.082901 16619 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:40.084301 16619 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:40.084395 16619 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:40.084481 16619 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:40.084512 16619 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:40.099499 16619 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:45011
I20260811 07:37:40.099594 16840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:45011 every 8 connection(s)
I20260811 07:37:40.100946 16619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:37:40.110687 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 16619
I20260811 07:37:40.110905 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:37:40.111248 22547 external_mini_cluster.cc:1428] Setting key 25b600d90bee8507be9086fa3d443110
Aug 11 07:37:40 dist-test-slave-7z32 krb5kdc[16190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433860, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:40.123255 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.103865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:57629 (local address 127.22.4.254:42339)
0811 07:37:40.104041 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.104045 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.105602 (+ 1557us) server_negotiation.cc:407] Connection header received
0811 07:37:40.107553 (+ 1951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.107556 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.107634 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.107730 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:40.109674 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.110316 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.112679 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.113021 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.113142 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.117063 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:40.117067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:40.117069 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:40.117105 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:40.119243 (+ 2138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:40.120034 (+ 791us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:40.120038 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:40.120039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:40.120184 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:40.121183 (+ 999us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:40.121186 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:40.121187 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:40.121493 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:40.121591 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.122885 (+ 1294us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.123072 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:37:40.124799 16844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.104399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:42339 (local address 127.22.4.194:57629)
0811 07:37:40.105253 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:40.105327 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:40.107226 (+ 1899us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:40.108142 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:40.108156 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:40.108749 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:40.109454 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.109472 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.110663 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.110668 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.112391 (+ 1723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.112420 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.113323 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.113329 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.113608 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.114566 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:40.114591 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:40.116753 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:40.119447 (+ 2694us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:40.119457 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:40.119494 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:40.119884 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:40.120480 (+ 596us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:40.120490 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:40.120495 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:40.120931 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:40.121661 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:40.121675 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:40.122301 (+ 626us) client_negotiation.cc:769] Sending connection context
0811 07:37:40.122735 (+ 434us) client_negotiation.cc:240] Negotiation successful
0811 07:37:40.123363 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":229,"threads_started":1}
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:37:40.127594 16841 heartbeater.cc:347] Connected to a master server at 127.22.4.254:42339
I20260811 07:37:40.128010 16841 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:40.128718 16841 heartbeater.cc:511] Master 127.22.4.254:42339 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:37:40.130962 16279 ts_manager.cc:194] Registered new tserver with Master: 1b205d0d37094a64a1e01558fe8d0e38 (127.22.4.194:45011)
I20260811 07:37:40.131776 16279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:57629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:37:40.156469 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42339
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:42385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:40.320418 16847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:40.321043 16847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:40.321235 16847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:40.327365 16847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:40.327502 16847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:40.327582 16847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:37:40.336656 16847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:42385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:42339
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:40.338505 16847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:40.340294 16847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:40.356761 16862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:40.356855 16847 server_base.cc:1034] running on GCE node
W20260811 07:37:40.357102 16857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:40.357476 16859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:40.358701 16847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:40.359951 16847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:40.361294 16847 hybrid_clock.cc:648] HybridClock initialized: now 1786433860361244 us; error 104 us; skew 500 ppm
Aug 11 07:37:40 dist-test-slave-7z32 krb5kdc[16190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433860, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:40.366307 16847 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:37:40.367934 16847 webserver.cc:460] Webserver started at http://127.22.4.195:33359/ using document root <none> and password file <none>
I20260811 07:37:40.368741 16847 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:40.368822 16847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:40.369063 16847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:40.372666 16847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "21fc2b73705a4018b2a5a8f5832129c8"
format_stamp: "Formatted at 2026-08-11 07:37:40 on dist-test-slave-7z32"
server_key: "09838b44cab167a373b68e730c1dda49"
server_key_iv: "35e0f73d664316e088fcf67866077729"
server_key_version: "encryptionkey@0"
I20260811 07:37:40.373492 16847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "21fc2b73705a4018b2a5a8f5832129c8"
format_stamp: "Formatted at 2026-08-11 07:37:40 on dist-test-slave-7z32"
server_key: "09838b44cab167a373b68e730c1dda49"
server_key_iv: "35e0f73d664316e088fcf67866077729"
server_key_version: "encryptionkey@0"
I20260811 07:37:40.380527 16847 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.004s
I20260811 07:37:40.385283 16875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:40.387589 16847 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260811 07:37:40.387856 16847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "21fc2b73705a4018b2a5a8f5832129c8"
format_stamp: "Formatted at 2026-08-11 07:37:40 on dist-test-slave-7z32"
server_key: "09838b44cab167a373b68e730c1dda49"
server_key_iv: "35e0f73d664316e088fcf67866077729"
server_key_version: "encryptionkey@0"
I20260811 07:37:40.388051 16847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:40.404317 16847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:40.410084 16847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:40.410409 16847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:40.411474 16847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:40.412899 16847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:40.412992 16847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:40.413062 16847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:40.413100 16847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:40.425777 16847 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:33901
I20260811 07:37:40.425845 17056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:33901 every 8 connection(s)
I20260811 07:37:40.427038 16847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:37:40.429931 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 16847
I20260811 07:37:40.430101 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:37:40.430466 22547 external_mini_cluster.cc:1428] Setting key 23a9a16ee09b4d89599ca4592637f063
Aug 11 07:37:40 dist-test-slave-7z32 krb5kdc[16190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433860, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:40.447974 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.429738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:55103 (local address 127.22.4.254:42339)
0811 07:37:40.429930 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.429933 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.431944 (+ 2011us) server_negotiation.cc:407] Connection header received
0811 07:37:40.433280 (+ 1336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.433284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.433369 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.433487 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:40.435406 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.436174 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.437731 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.438020 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.438149 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.442041 (+ 3892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:40.442046 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:40.442049 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:40.442093 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:40.444346 (+ 2253us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:40.445380 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:40.445385 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:40.445386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:40.445535 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:40.446189 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:40.446196 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:40.446199 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:40.446512 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:40.446649 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.447660 (+ 1011us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.447824 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260811 07:37:40.449241 17062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.430314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:42339 (local address 127.22.4.195:55103)
0811 07:37:40.431676 (+ 1362us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:40.431755 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:40.432970 (+ 1215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:40.433766 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:40.433776 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:40.434405 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:40.435188 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.435208 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.436382 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.436385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.437492 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.437505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.438261 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.438266 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.438451 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.439428 (+ 977us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:40.439451 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:40.441695 (+ 2244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:40.444585 (+ 2890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:40.444596 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:40.444628 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:40.445202 (+ 574us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:40.445671 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:40.445675 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:40.445677 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:40.445967 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:40.446690 (+ 723us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:40.446699 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:40.447276 (+ 577us) client_negotiation.cc:769] Sending connection context
0811 07:37:40.447512 (+ 236us) client_negotiation.cc:240] Negotiation successful
0811 07:37:40.447933 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":984,"thread_start_us":207,"threads_started":1}
I20260811 07:37:40.451313 17059 heartbeater.cc:347] Connected to a master server at 127.22.4.254:42339
I20260811 07:37:40.451785 17059 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:40.452600 17059 heartbeater.cc:511] Master 127.22.4.254:42339 requested a full tablet report, sending...
I20260811 07:37:40.454435 16279 ts_manager.cc:194] Registered new tserver with Master: 21fc2b73705a4018b2a5a8f5832129c8 (127.22.4.195:33901)
I20260811 07:37:40.455529 16279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:55103
I20260811 07:37:40.460860 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:37:40.476074 16349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.464205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41608 (local address 127.22.4.254:42339)
0811 07:37:40.464465 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.464470 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.464761 (+ 291us) server_negotiation.cc:407] Connection header received
0811 07:37:40.465169 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.465174 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.465247 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.465360 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:40.466660 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.467270 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.468329 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.468593 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.468718 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.471340 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:40.471345 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:40.471348 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:40.471393 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:40.473476 (+ 2083us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:40.474192 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:40.474196 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:40.474197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:40.474308 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:40.474662 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:40.474665 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:40.474666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:40.475116 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:40.475276 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.475677 (+ 401us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.475830 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260811 07:37:40.481563 16279 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41608:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:37:40.486784 16279 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:37:40.511700 17080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.502798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35994 (local address 127.22.4.195:33901)
0811 07:37:40.504092 (+ 1294us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.504112 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.504157 (+ 45us) server_negotiation.cc:407] Connection header received
0811 07:37:40.504282 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.504292 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.504600 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.505032 (+ 432us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:40.505474 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.506974 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.509434 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.510573 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.510793 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.511230 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.511327 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.511486 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1144,"thread_start_us":208,"threads_started":1}
I20260811 07:37:40.511818 17084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.504223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55916 (local address 127.22.4.194:45011)
0811 07:37:40.504732 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.504746 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.504774 (+ 28us) server_negotiation.cc:407] Connection header received
0811 07:37:40.505056 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.505066 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.505346 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.505551 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:40.506182 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.507337 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.509449 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.510330 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.510455 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.510644 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.511487 (+ 843us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.511637 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394,"thread_start_us":143,"threads_started":1}
I20260811 07:37:40.512076 17081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.502960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48648 (local address 127.22.4.193:34693)
0811 07:37:40.504394 (+ 1434us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.504401 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.504427 (+ 26us) server_negotiation.cc:407] Connection header received
0811 07:37:40.504546 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.504552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.504733 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.505329 (+ 596us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:40.505519 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.506974 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.509156 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.510283 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.510447 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.510644 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.511508 (+ 864us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.511671 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":754,"thread_start_us":145,"threads_started":1}
I20260811 07:37:40.512292 17078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.502573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:33901 (local address 127.0.0.1:35994)
0811 07:37:40.503637 (+ 1064us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:40.503712 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:40.503906 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:40.504861 (+ 955us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:40.504872 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:40.504914 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:40.505332 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.505339 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.507262 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.507268 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.509213 (+ 1945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.509227 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.510734 (+ 1507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.510737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.511021 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.511086 (+ 65us) client_negotiation.cc:769] Sending connection context
0811 07:37:40.511173 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 07:37:40.511354 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"mutex_wait_us":715,"spinlock_wait_cycles":16384,"thread_start_us":245,"threads_started":1}
I20260811 07:37:40.512643 17079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.502624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:34693 (local address 127.0.0.1:48648)
0811 07:37:40.503692 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:40.503712 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:40.503906 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:40.504885 (+ 979us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:40.504888 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:40.504912 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:40.505145 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.505165 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.507142 (+ 1977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.507147 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.508956 (+ 1809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.508969 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.510465 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.510470 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.510659 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.510739 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 07:37:40.510925 (+ 186us) client_negotiation.cc:240] Negotiation successful
0811 07:37:40.511317 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1008,"mutex_wait_us":69,"spinlock_wait_cycles":16128,"thread_start_us":220,"threads_started":1}
I20260811 07:37:40.512976 17083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.504002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:45011 (local address 127.0.0.1:55916)
0811 07:37:40.504413 (+ 411us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:40.504443 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:40.504547 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:40.505792 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:40.505796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:40.505899 (+ 103us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:40.506026 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.506032 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.507527 (+ 1495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.507530 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.509272 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.509281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.510740 (+ 1459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.510744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.510984 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.511080 (+ 96us) client_negotiation.cc:769] Sending connection context
0811 07:37:40.511173 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 07:37:40.511354 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"mutex_wait_us":382,"thread_start_us":156,"threads_started":1}
I20260811 07:37:40.517128 16729 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5922ac97354e779dbe04f58da92ac9 (DEFAULT_TABLE table=test-table [id=3da35fd142c64f4890210ebdad450c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:40.518471 16729 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5922ac97354e779dbe04f58da92ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:40.517450 16493 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5922ac97354e779dbe04f58da92ac9 (DEFAULT_TABLE table=test-table [id=3da35fd142c64f4890210ebdad450c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:40.519667 16493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5922ac97354e779dbe04f58da92ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:40.517450 16960 tablet_service.cc:1467] Processing CreateTablet for tablet 0f5922ac97354e779dbe04f58da92ac9 (DEFAULT_TABLE table=test-table [id=3da35fd142c64f4890210ebdad450c0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:40.520742 16960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0f5922ac97354e779dbe04f58da92ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:40.527802 17088 tablet_bootstrap.cc:492] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Bootstrap starting.
I20260811 07:37:40.529838 17089 tablet_bootstrap.cc:492] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Bootstrap starting.
I20260811 07:37:40.531168 17090 tablet_bootstrap.cc:492] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a: Bootstrap starting.
I20260811 07:37:40.532550 17089 tablet_bootstrap.cc:654] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:40.533092 17088 tablet_bootstrap.cc:654] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:40.534106 17089 log.cc:824] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:40.534106 17088 log.cc:824] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:40.534147 17090 tablet_bootstrap.cc:654] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:40.535419 17090 log.cc:824] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:40.536876 17088 tablet_bootstrap.cc:492] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: No bootstrap required, opened a new log
I20260811 07:37:40.536876 17089 tablet_bootstrap.cc:492] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: No bootstrap required, opened a new log
I20260811 07:37:40.537143 17089 ts_tablet_manager.cc:1397] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 07:37:40.537143 17088 ts_tablet_manager.cc:1397] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260811 07:37:40.538005 17090 tablet_bootstrap.cc:492] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a: No bootstrap required, opened a new log
I20260811 07:37:40.538297 17090 ts_tablet_manager.cc:1397] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:37:40.541952 17088 raft_consensus.cc:348] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.541952 17089 raft_consensus.cc:348] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.542400 17089 raft_consensus.cc:374] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:40.542400 17088 raft_consensus.cc:374] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:40.542466 17089 raft_consensus.cc:729] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21fc2b73705a4018b2a5a8f5832129c8, State: Initialized, Role: FOLLOWER
I20260811 07:37:40.542466 17088 raft_consensus.cc:729] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b205d0d37094a64a1e01558fe8d0e38, State: Initialized, Role: FOLLOWER
I20260811 07:37:40.543177 17088 consensus_queue.cc:260] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.543177 17089 consensus_queue.cc:260] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.544137 17090 raft_consensus.cc:348] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.544595 17090 raft_consensus.cc:374] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:40.544621 17089 ts_tablet_manager.cc:1428] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260811 07:37:40.544659 17090 raft_consensus.cc:729] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c3f4393d73143688eb95524fdee524a, State: Initialized, Role: FOLLOWER
I20260811 07:37:40.544680 17059 heartbeater.cc:503] Master 127.22.4.254:42339 was elected leader, sending a full tablet report...
I20260811 07:37:40.544788 17088 ts_tablet_manager.cc:1428] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s
I20260811 07:37:40.545392 17090 consensus_queue.cc:260] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.546548 16841 heartbeater.cc:503] Master 127.22.4.254:42339 was elected leader, sending a full tablet report...
I20260811 07:37:40.546615 16608 heartbeater.cc:503] Master 127.22.4.254:42339 was elected leader, sending a full tablet report...
I20260811 07:37:40.547179 17090 ts_tablet_manager.cc:1428] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
W20260811 07:37:40.603085 16842 tablet.cc:2369] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:37:40.678539 17060 tablet.cc:2369] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:37:40.795192 16609 tablet.cc:2369] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:40.871413 17097 raft_consensus.cc:482] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:40.871886 17097 raft_consensus.cc:504] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.873979 17097 leader_election.cc:288] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c3f4393d73143688eb95524fdee524a (127.22.4.193:34693), 1b205d0d37094a64a1e01558fe8d0e38 (127.22.4.194:45011)
I20260811 07:37:40.880627 17062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.874550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:34693 (local address 127.22.4.195:47119)
0811 07:37:40.874890 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:40.874913 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:40.875095 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:40.875586 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:40.875590 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:40.875614 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:40.875802 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.875809 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.876974 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.876977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.878546 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.878561 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.879855 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.879859 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.880120 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.880180 (+ 60us) client_negotiation.cc:769] Sending connection context
0811 07:37:40.880299 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 07:37:40.880408 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":58}
I20260811 07:37:40.880710 17084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.875287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:41217 (local address 127.22.4.194:45011)
0811 07:37:40.875461 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.875466 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.875835 (+ 369us) server_negotiation.cc:407] Connection header received
0811 07:37:40.875950 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.875953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.876026 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.876131 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:40.876512 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.877187 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.878896 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.879568 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.879749 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.879826 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.880385 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.880514 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:37:40.880712 17081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.874658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:47119 (local address 127.22.4.193:34693)
0811 07:37:40.874898 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.874967 (+ 69us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.874998 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:37:40.875337 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.875345 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.875437 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.875562 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:40.875962 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.876779 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.878813 (+ 2034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.879574 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.879749 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.879826 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.880385 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.880514 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260811 07:37:40.880635 17106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.875060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:45011 (local address 127.22.4.195:41217)
0811 07:37:40.875654 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:40.875677 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:40.875799 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:40.876211 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:40.876213 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:40.876233 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:40.876361 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.876366 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.877493 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.877497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.878683 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:40.878694 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.879842 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.879847 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:40.880124 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.880179 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 07:37:40.880299 (+ 120us) client_negotiation.cc:240] Negotiation successful
0811 07:37:40.880432 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":527,"mutex_wait_us":85,"thread_start_us":241,"threads_started":1}
I20260811 07:37:40.882053 16762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5922ac97354e779dbe04f58da92ac9" candidate_uuid: "21fc2b73705a4018b2a5a8f5832129c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b205d0d37094a64a1e01558fe8d0e38" is_pre_election: true
I20260811 07:37:40.882205 16527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5922ac97354e779dbe04f58da92ac9" candidate_uuid: "21fc2b73705a4018b2a5a8f5832129c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3f4393d73143688eb95524fdee524a" is_pre_election: true
I20260811 07:37:40.882766 16527 raft_consensus.cc:2454] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fc2b73705a4018b2a5a8f5832129c8 in term 0.
I20260811 07:37:40.882794 16762 raft_consensus.cc:2454] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21fc2b73705a4018b2a5a8f5832129c8 in term 0.
I20260811 07:37:40.883817 16878 leader_election.cc:302] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21fc2b73705a4018b2a5a8f5832129c8, 5c3f4393d73143688eb95524fdee524a; no voters:
I20260811 07:37:40.884347 17097 raft_consensus.cc:2781] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:37:40.884558 17097 raft_consensus.cc:482] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:37:40.884629 17097 raft_consensus.cc:3037] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:40.886039 17097 raft_consensus.cc:504] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.886528 17097 leader_election.cc:288] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [CANDIDATE]: Term 1 election: Requested vote from peers 5c3f4393d73143688eb95524fdee524a (127.22.4.193:34693), 1b205d0d37094a64a1e01558fe8d0e38 (127.22.4.194:45011)
I20260811 07:37:40.887410 16527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5922ac97354e779dbe04f58da92ac9" candidate_uuid: "21fc2b73705a4018b2a5a8f5832129c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3f4393d73143688eb95524fdee524a"
I20260811 07:37:40.887560 16762 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0f5922ac97354e779dbe04f58da92ac9" candidate_uuid: "21fc2b73705a4018b2a5a8f5832129c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b205d0d37094a64a1e01558fe8d0e38"
I20260811 07:37:40.887668 16527 raft_consensus.cc:3037] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:40.887794 16762 raft_consensus.cc:3037] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:40.889168 16762 raft_consensus.cc:2454] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fc2b73705a4018b2a5a8f5832129c8 in term 1.
I20260811 07:37:40.889516 16527 raft_consensus.cc:2454] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21fc2b73705a4018b2a5a8f5832129c8 in term 1.
I20260811 07:37:40.889742 16878 leader_election.cc:302] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b205d0d37094a64a1e01558fe8d0e38, 21fc2b73705a4018b2a5a8f5832129c8; no voters:
I20260811 07:37:40.890203 17097 raft_consensus.cc:2781] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:40.890421 17097 raft_consensus.cc:686] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 1 LEADER]: Becoming Leader. State: Replica: 21fc2b73705a4018b2a5a8f5832129c8, State: Running, Role: LEADER
I20260811 07:37:40.890901 17097 consensus_queue.cc:237] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } }
I20260811 07:37:40.895327 16279 catalog_manager.cc:5495] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21fc2b73705a4018b2a5a8f5832129c8 (127.22.4.195). New cstate: current_term: 1 leader_uuid: "21fc2b73705a4018b2a5a8f5832129c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "21fc2b73705a4018b2a5a8f5832129c8" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33901 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 } health_report { overall_health: UNKNOWN } } }
I20260811 07:37:40.985984 17080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:40.980671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35998 (local address 127.22.4.195:33901)
0811 07:37:40.981010 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:40.981022 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:40.981216 (+ 194us) server_negotiation.cc:407] Connection header received
0811 07:37:40.981536 (+ 320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:40.981540 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:40.981662 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:40.981824 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:37:40.982144 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.982864 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.983887 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:40.984153 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:40.984279 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:40.984696 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:37:40.985375 (+ 679us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:37:40.985542 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:40.985619 (+ 77us) server_negotiation.cc:299] Negotiation successful
0811 07:37:40.985712 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187}
I20260811 07:37:40.998056 16527 raft_consensus.cc:1261] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [term 1 FOLLOWER]: Refusing update from remote peer 21fc2b73705a4018b2a5a8f5832129c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:40.998570 16762 raft_consensus.cc:1261] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 1 FOLLOWER]: Refusing update from remote peer 21fc2b73705a4018b2a5a8f5832129c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:40.999475 17107 consensus_queue.cc:1035] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3f4393d73143688eb95524fdee524a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:41.000006 17097 consensus_queue.cc:1035] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b205d0d37094a64a1e01558fe8d0e38" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 45011 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:41.016134 17113 mvcc.cc:205] Tried to move back new op lower bound from 7317233094636507136 to 7317233094212714496. Current Snapshot: MvccSnapshot[applied={T|T < 7317233094636507136}]
I20260811 07:37:41.020853 17115 mvcc.cc:205] Tried to move back new op lower bound from 7317233094636507136 to 7317233094212714496. Current Snapshot: MvccSnapshot[applied={T|T < 7317233094636507136}]
I20260811 07:37:41.037295 16276 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:41.037599 16276 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41608:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:41.043192 16276 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2911ad6bc0d5462396fea40db6d5d2a0: Sending DeleteTablet for 3 replicas of tablet 0f5922ac97354e779dbe04f58da92ac9
I20260811 07:37:41.045076 16960 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5922ac97354e779dbe04f58da92ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:41 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:35994
I20260811 07:37:41.045259 16493 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5922ac97354e779dbe04f58da92ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:41 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:48648
I20260811 07:37:41.045472 16729 tablet_service.cc:1514] Processing DeleteTablet for tablet 0f5922ac97354e779dbe04f58da92ac9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:41 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:55916
I20260811 07:37:41.046259 17127 tablet_replica.cc:330] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a: stopping tablet replica
I20260811 07:37:41.046571 17129 tablet_replica.cc:330] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: stopping tablet replica
I20260811 07:37:41.046964 17126 tablet_replica.cc:330] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: stopping tablet replica
I20260811 07:37:41.047143 17127 raft_consensus.cc:2229] T 0f5922ac97354e779dbe04f58da92ac9 P 5c3f4393d73143688eb95524fdee524a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:41.047142 17129 raft_consensus.cc:2229] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:41.047329 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 16391
I20260811 07:37:41.047636 17129 raft_consensus.cc:2258] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:41.047683 17126 raft_consensus.cc:2229] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:37:41.048766 17126 raft_consensus.cc:2258] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:41.050148 17129 ts_tablet_manager.cc:1905] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:41.061394 17126 ts_tablet_manager.cc:1905] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:41.069605 17129 ts_tablet_manager.cc:1918] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:41.069823 17129 log.cc:1196] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/0f5922ac97354e779dbe04f58da92ac9
I20260811 07:37:41.070218 17129 ts_tablet_manager.cc:1939] T 0f5922ac97354e779dbe04f58da92ac9 P 1b205d0d37094a64a1e01558fe8d0e38: Deleting consensus metadata
I20260811 07:37:41.072188 17126 ts_tablet_manager.cc:1918] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:41.072336 17126 log.cc:1196] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/0f5922ac97354e779dbe04f58da92ac9
I20260811 07:37:41.072640 17126 ts_tablet_manager.cc:1939] T 0f5922ac97354e779dbe04f58da92ac9 P 21fc2b73705a4018b2a5a8f5832129c8: Deleting consensus metadata
I20260811 07:37:41.074688 16253 catalog_manager.cc:4841] TS 21fc2b73705a4018b2a5a8f5832129c8 (127.22.4.195:33901): tablet 0f5922ac97354e779dbe04f58da92ac9 (table test-table [id=3da35fd142c64f4890210ebdad450c0b]) successfully deleted
I20260811 07:37:41.076372 16252 catalog_manager.cc:4841] TS 1b205d0d37094a64a1e01558fe8d0e38 (127.22.4.194:45011): tablet 0f5922ac97354e779dbe04f58da92ac9 (table test-table [id=3da35fd142c64f4890210ebdad450c0b]) successfully deleted
W20260811 07:37:41.092664 16252 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:34693 (error 108)
I20260811 07:37:41.092842 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 16619
I20260811 07:37:41.101245 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:41.100073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:34693 (local address 127.0.0.1:48650)
0811 07:37:41.100962 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:41.101088 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:34693: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":450,"threads_started":1}
W20260811 07:37:41.101950 16252 catalog_manager.cc:4584] TS 5c3f4393d73143688eb95524fdee524a (127.22.4.193:34693): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0f5922ac97354e779dbe04f58da92ac9: Network error: Client connection negotiation failed: client connection to 127.22.4.193:34693: connect: Connection refused (error 111)
I20260811 07:37:41.113554 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 16847
I20260811 07:37:41.140543 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 16214
2026-08-11T07:37:41Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (3856 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T07:37:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:41Z Disabled control of system clock
I20260811 07:37:41.195598 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37447
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:38893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:37447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:37:41.382769 17137 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:41.383258 17137 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:41.383308 17137 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:41.388276 17137 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:41.388382 17137 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:41.388399 17137 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:41.388419 17137 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:41.388437 17137 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:41.394389 17137 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:37447
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17137
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:41.396214 17137 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:41.398170 17137 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:41.410915 17143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:41.410925 17146 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:41.410934 17142 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:41.411892 17137 server_base.cc:1034] running on GCE node
I20260811 07:37:41.412782 17137 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:41.414216 17137 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:41.417659 17137 hybrid_clock.cc:648] HybridClock initialized: now 1786433861417613 us; error 62 us; skew 500 ppm
I20260811 07:37:41.421032 17137 webserver.cc:460] Webserver started at http://127.22.4.254:36581/ using document root <none> and password file <none>
I20260811 07:37:41.422508 17137 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:41.422704 17137 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:41.423167 17137 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:41.426738 17137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478"
format_stamp: "Formatted at 2026-08-11 07:37:41 on dist-test-slave-7z32"
server_key: "bca1f89d24c050403c2c415c8d71c658"
server_key_iv: "b0b8f468ed819c7401f958e177069908"
server_key_version: "encryptionkey@0"
I20260811 07:37:41.427853 17137 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478"
format_stamp: "Formatted at 2026-08-11 07:37:41 on dist-test-slave-7z32"
server_key: "bca1f89d24c050403c2c415c8d71c658"
server_key_iv: "b0b8f468ed819c7401f958e177069908"
server_key_version: "encryptionkey@0"
I20260811 07:37:41.433283 17137 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:37:41.437180 17155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:41.439302 17137 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:37:41.439527 17137 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478"
format_stamp: "Formatted at 2026-08-11 07:37:41 on dist-test-slave-7z32"
server_key: "bca1f89d24c050403c2c415c8d71c658"
server_key_iv: "b0b8f468ed819c7401f958e177069908"
server_key_version: "encryptionkey@0"
I20260811 07:37:41.439698 17137 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:41.454618 17137 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:41.455616 17137 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:41.455832 17137 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:41.466442 17137 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:37447
I20260811 07:37:41.466473 17249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:37447 every 8 connection(s)
I20260811 07:37:41.468024 17137 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:41.470090 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 17137
I20260811 07:37:41.470297 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:41.470721 22547 external_mini_cluster.cc:1428] Setting key 968bd2b70eea7a6a16066b76a75bec72
I20260811 07:37:41.474792 17251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:41.486447 17251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478: Bootstrap starting.
I20260811 07:37:41.486760 17262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:41.473191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42580 (local address 127.22.4.254:37447)
0811 07:37:41.474121 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:41.474149 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:41.474197 (+ 48us) server_negotiation.cc:407] Connection header received
0811 07:37:41.475349 (+ 1152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:41.475439 (+ 90us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:41.476020 (+ 581us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:41.476428 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:41.477135 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:41.478545 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:41.480704 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:41.481495 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:41.481727 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:41.483630 (+ 1903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:41.483638 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:41.483662 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:41.484261 (+ 599us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:41.484361 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:41.484391 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:41.484752 (+ 361us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:41.485079 (+ 327us) server_negotiation.cc:299] Negotiation successful
0811 07:37:41.485582 (+ 503us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":6,"server-negotiator.queue_time_us":441,"thread_start_us":231,"threads_started":1}
I20260811 07:37:41.490669 17251 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:41.492000 17251 log.cc:824] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:41.496287 17251 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478: No bootstrap required, opened a new log
I20260811 07:37:41.501950 17251 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37447 } }
I20260811 07:37:41.502436 17251 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:41.502501 17251 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f69e5d6e2fb4b1faa016fb6f64cb478, State: Initialized, Role: FOLLOWER
I20260811 07:37:41.503764 17251 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37447 } }
I20260811 07:37:41.504029 17251 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:41.504099 17251 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:41.504321 17251 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:41.507259 17251 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37447 } }
I20260811 07:37:41.508301 17251 leader_election.cc:302] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f69e5d6e2fb4b1faa016fb6f64cb478; no voters:
I20260811 07:37:41.509069 17251 leader_election.cc:288] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:41.510427 17269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:41.510980 17269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [term 1 LEADER]: Becoming Leader. State: Replica: 2f69e5d6e2fb4b1faa016fb6f64cb478, State: Running, Role: LEADER
I20260811 07:37:41.511476 17269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37447 } }
I20260811 07:37:41.512984 17251 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:41.514441 17272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f69e5d6e2fb4b1faa016fb6f64cb478. Latest consensus state: current_term: 1 leader_uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37447 } } }
I20260811 07:37:41.514734 17272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:41.515064 17271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f69e5d6e2fb4b1faa016fb6f64cb478" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37447 } } }
I20260811 07:37:41.515169 17271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:41.515789 17283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:41.521381 17283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:41.533725 17283 catalog_manager.cc:1347] Generated new cluster ID: e1fef5dd76354a8e9795391e7c8e590b
I20260811 07:37:41.533885 17283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:41.558499 17283 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:41.560294 17283 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:41.568518 17283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478: Generated new TSK 0
I20260811 07:37:41.569751 17283 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:37:41.580035 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37447
--builtin_ntp_servers=127.22.4.212:38893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:37:41.744630 17297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:41.745074 17297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:41.745128 17297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:41.750160 17297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:41.750285 17297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:41.750358 17297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:37:41.756796 17297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:41.758674 17297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:41.760982 17297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:41.777864 17308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:41.777855 17306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:41.777855 17303 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:41.778475 17297 server_base.cc:1034] running on GCE node
I20260811 07:37:41.779314 17297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:41.780407 17297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:41.783869 17297 hybrid_clock.cc:648] HybridClock initialized: now 1786433861783792 us; error 59 us; skew 500 ppm
I20260811 07:37:41.787261 17297 webserver.cc:460] Webserver started at http://127.22.4.193:41007/ using document root <none> and password file <none>
I20260811 07:37:41.788213 17297 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:41.788348 17297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:41.788717 17297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:41.791731 17297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "2a3567edb33141a480d9b544215b4bc6"
format_stamp: "Formatted at 2026-08-11 07:37:41 on dist-test-slave-7z32"
server_key: "0f96e396d20c640e96bac9b161a38d66"
server_key_iv: "9be9899c87f96c3a0951fe764410aa13"
server_key_version: "encryptionkey@0"
I20260811 07:37:41.792578 17297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "2a3567edb33141a480d9b544215b4bc6"
format_stamp: "Formatted at 2026-08-11 07:37:41 on dist-test-slave-7z32"
server_key: "0f96e396d20c640e96bac9b161a38d66"
server_key_iv: "9be9899c87f96c3a0951fe764410aa13"
server_key_version: "encryptionkey@0"
I20260811 07:37:41.799752 17297 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260811 07:37:41.804191 17316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:41.806480 17297 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:37:41.806699 17297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "2a3567edb33141a480d9b544215b4bc6"
format_stamp: "Formatted at 2026-08-11 07:37:41 on dist-test-slave-7z32"
server_key: "0f96e396d20c640e96bac9b161a38d66"
server_key_iv: "9be9899c87f96c3a0951fe764410aa13"
server_key_version: "encryptionkey@0"
I20260811 07:37:41.807107 17297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:41.843072 17297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:41.844192 17297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:41.844565 17297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:41.845510 17297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:41.847659 17297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:41.848003 17297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:41.848165 17297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:41.848223 17297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:41.861836 17297 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:44385
I20260811 07:37:41.861883 17500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:44385 every 8 connection(s)
I20260811 07:37:41.863596 17297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:37:41.873926 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 17297
I20260811 07:37:41.874228 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:37:41.874627 22547 external_mini_cluster.cc:1428] Setting key 25bcc9bcf8264e24bc90e39b4b89a74c
I20260811 07:37:41.878419 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37447
--builtin_ntp_servers=127.22.4.212:38893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:37:41.879752 17262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:41.867056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:50355 (local address 127.22.4.254:37447)
0811 07:37:41.867324 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:41.867329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:41.869270 (+ 1941us) server_negotiation.cc:407] Connection header received
0811 07:37:41.871556 (+ 2286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:41.871560 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:41.871645 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:41.871784 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:41.873298 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:41.873977 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:41.875904 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:41.876219 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:41.876347 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:41.878736 (+ 2389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:41.878744 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:41.878749 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:41.878784 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:41.878878 (+ 94us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:41.878895 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:41.879027 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:41.879471 (+ 444us) server_negotiation.cc:299] Negotiation successful
0811 07:37:41.879587 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 07:37:41.881546 17504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:41.867554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37447 (local address 127.22.4.193:50355)
0811 07:37:41.868960 (+ 1406us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:41.869039 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:41.871163 (+ 2124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:41.872092 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:41.872111 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:41.872249 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:41.873042 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:41.873064 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:41.874241 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:41.874247 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:41.875732 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:41.875751 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:41.876538 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:41.876544 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:41.877023 (+ 479us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:41.878082 (+ 1059us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:41.878087 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:41.878183 (+ 96us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:41.878362 (+ 179us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:41.879069 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:41.879085 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:41.879098 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 07:37:41.879364 (+ 266us) client_negotiation.cc:240] Negotiation successful
0811 07:37:41.879930 (+ 566us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"thread_start_us":205,"threads_started":1}
I20260811 07:37:41.884179 17501 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37447
I20260811 07:37:41.884788 17501 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:41.885802 17501 heartbeater.cc:511] Master 127.22.4.254:37447 requested a full tablet report, sending...
I20260811 07:37:41.888831 17189 ts_manager.cc:194] Registered new tserver with Master: 2a3567edb33141a480d9b544215b4bc6 (127.22.4.193:44385)
I20260811 07:37:41.891482 17189 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.193:50355
W20260811 07:37:42.042503 17505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:42.042975 17505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:42.043032 17505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:42.047610 17505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:42.047703 17505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:42.047766 17505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:37:42.053092 17505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:42.054447 17505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:42.056061 17505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:42.068813 17520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:42.068749 17515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:42.068768 17514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:42.069370 17505 server_base.cc:1034] running on GCE node
I20260811 07:37:42.070341 17505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:42.071671 17505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:42.072997 17505 hybrid_clock.cc:648] HybridClock initialized: now 1786433862072931 us; error 76 us; skew 500 ppm
I20260811 07:37:42.076498 17505 webserver.cc:460] Webserver started at http://127.22.4.194:43935/ using document root <none> and password file <none>
I20260811 07:37:42.077518 17505 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:42.077656 17505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:42.077981 17505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:42.081609 17505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "a231f7aedc19488888e8d1dc69629ddd"
format_stamp: "Formatted at 2026-08-11 07:37:42 on dist-test-slave-7z32"
server_key: "1e5e912327d91d6d87963ec0f72b6ff1"
server_key_iv: "ef4c83ddf9acaeec29fe691db9ac0f0e"
server_key_version: "encryptionkey@0"
I20260811 07:37:42.083210 17505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "a231f7aedc19488888e8d1dc69629ddd"
format_stamp: "Formatted at 2026-08-11 07:37:42 on dist-test-slave-7z32"
server_key: "1e5e912327d91d6d87963ec0f72b6ff1"
server_key_iv: "ef4c83ddf9acaeec29fe691db9ac0f0e"
server_key_version: "encryptionkey@0"
I20260811 07:37:42.090337 17505 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260811 07:37:42.095065 17532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:42.097822 17505 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:37:42.098110 17505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "a231f7aedc19488888e8d1dc69629ddd"
format_stamp: "Formatted at 2026-08-11 07:37:42 on dist-test-slave-7z32"
server_key: "1e5e912327d91d6d87963ec0f72b6ff1"
server_key_iv: "ef4c83ddf9acaeec29fe691db9ac0f0e"
server_key_version: "encryptionkey@0"
I20260811 07:37:42.098359 17505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:42.120272 17505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:42.121377 17505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:42.121637 17505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:42.122484 17505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:42.123915 17505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:42.124001 17505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:42.124085 17505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:42.124128 17505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:42.139796 17505 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:44537
I20260811 07:37:42.139820 17716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:44537 every 8 connection(s)
I20260811 07:37:42.141283 17505 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:37:42.143224 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 17505
I20260811 07:37:42.143365 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:37:42.143848 22547 external_mini_cluster.cc:1428] Setting key 3474bb090df33747adbc14eadd0145db
I20260811 07:37:42.146580 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37447
--builtin_ntp_servers=127.22.4.212:38893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:37:42.155647 17262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.144147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:44359 (local address 127.22.4.254:37447)
0811 07:37:42.144329 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.144337 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.146078 (+ 1741us) server_negotiation.cc:407] Connection header received
0811 07:37:42.147999 (+ 1921us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.148007 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.148105 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.148260 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:42.149587 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.150193 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.151738 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.152155 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.152312 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.154452 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:42.154460 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:42.154466 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:42.154501 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:42.154551 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:42.154572 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:42.154698 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.155212 (+ 514us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.155360 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:37:42.156842 17723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.144789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37447 (local address 127.22.4.194:44359)
0811 07:37:42.145856 (+ 1067us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:42.145921 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:42.147629 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:42.148507 (+ 878us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:42.148516 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:42.148632 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:42.149357 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.149374 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.150363 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.150367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.151556 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.151570 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.152518 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.152525 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.152813 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.153770 (+ 957us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:42.153773 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:42.153834 (+ 61us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:42.154125 (+ 291us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:42.154791 (+ 666us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:42.154805 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:42.154814 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 07:37:42.155187 (+ 373us) client_negotiation.cc:240] Negotiation successful
0811 07:37:42.155601 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":243,"threads_started":1}
I20260811 07:37:42.159293 17719 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37447
I20260811 07:37:42.159731 17719 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:42.160537 17719 heartbeater.cc:511] Master 127.22.4.254:37447 requested a full tablet report, sending...
I20260811 07:37:42.162267 17189 ts_manager.cc:194] Registered new tserver with Master: a231f7aedc19488888e8d1dc69629ddd (127.22.4.194:44537)
I20260811 07:37:42.163089 17189 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.194:44359
W20260811 07:37:42.311401 17725 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:42.311866 17725 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:42.311923 17725 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:42.318084 17725 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:42.318221 17725 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:42.318341 17725 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:37:42.325131 17725 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17725
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:42.327003 17725 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:42.330207 17725 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:42.344987 17734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:42.344888 17736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:42.344950 17742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:42.345485 17725 server_base.cc:1034] running on GCE node
I20260811 07:37:42.346150 17725 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:42.347131 17725 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:42.348721 17725 hybrid_clock.cc:648] HybridClock initialized: now 1786433862348658 us; error 95 us; skew 500 ppm
I20260811 07:37:42.351747 17725 webserver.cc:460] Webserver started at http://127.22.4.195:33393/ using document root <none> and password file <none>
I20260811 07:37:42.352728 17725 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:42.352898 17725 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:42.353205 17725 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:42.356447 17725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "0b0b559d95eb4bbc9606eb88fb906038"
format_stamp: "Formatted at 2026-08-11 07:37:42 on dist-test-slave-7z32"
server_key: "a82c4adb77fb34b1c8f70eb052e01924"
server_key_iv: "d87fbfc2b4f94b980873391f7673f49b"
server_key_version: "encryptionkey@0"
I20260811 07:37:42.357242 17725 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "0b0b559d95eb4bbc9606eb88fb906038"
format_stamp: "Formatted at 2026-08-11 07:37:42 on dist-test-slave-7z32"
server_key: "a82c4adb77fb34b1c8f70eb052e01924"
server_key_iv: "d87fbfc2b4f94b980873391f7673f49b"
server_key_version: "encryptionkey@0"
I20260811 07:37:42.363253 17725 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260811 07:37:42.367231 17754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:42.369024 17725 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:37:42.369267 17725 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "0b0b559d95eb4bbc9606eb88fb906038"
format_stamp: "Formatted at 2026-08-11 07:37:42 on dist-test-slave-7z32"
server_key: "a82c4adb77fb34b1c8f70eb052e01924"
server_key_iv: "d87fbfc2b4f94b980873391f7673f49b"
server_key_version: "encryptionkey@0"
I20260811 07:37:42.369443 17725 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:42.393148 17725 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:42.394129 17725 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:42.394394 17725 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:42.395180 17725 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:42.396785 17725 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:42.396881 17725 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:42.396961 17725 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:42.397023 17725 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:42.411563 17725 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:46073
I20260811 07:37:42.411633 17939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:46073 every 8 connection(s)
I20260811 07:37:42.413285 17725 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:37:42.421928 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 17725
I20260811 07:37:42.422076 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:37:42.422442 22547 external_mini_cluster.cc:1428] Setting key 820660f15dd11e9be2dd249a78ca330e
I20260811 07:37:42.430670 17262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.418430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:44083 (local address 127.22.4.254:37447)
0811 07:37:42.418650 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.418655 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.420835 (+ 2180us) server_negotiation.cc:407] Connection header received
0811 07:37:42.423297 (+ 2462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.423302 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.423395 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.423501 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:42.424906 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.425583 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.427692 (+ 2109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.427993 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.428167 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.429972 (+ 1805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:42.429976 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:42.429978 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:42.429998 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:42.430024 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:42.430035 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:42.430125 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.430344 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.430464 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 07:37:42.432191 17943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.419163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37447 (local address 127.22.4.195:44083)
0811 07:37:42.420523 (+ 1360us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:42.420615 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:42.422759 (+ 2144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:42.423776 (+ 1017us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:42.423788 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:42.423919 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:42.424711 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.424736 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.426003 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.426010 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.427468 (+ 1458us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.427484 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.428242 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.428248 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.428520 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.429521 (+ 1001us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:42.429522 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:42.429593 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:42.429716 (+ 123us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:42.430133 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:42.430150 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:42.430161 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:37:42.430341 (+ 180us) client_negotiation.cc:240] Negotiation successful
0811 07:37:42.430866 (+ 525us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"thread_start_us":245,"threads_started":1}
I20260811 07:37:42.434285 17941 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37447
I20260811 07:37:42.434682 17941 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:42.435514 17941 heartbeater.cc:511] Master 127.22.4.254:37447 requested a full tablet report, sending...
I20260811 07:37:42.437160 17188 ts_manager.cc:194] Registered new tserver with Master: 0b0b559d95eb4bbc9606eb88fb906038 (127.22.4.195:46073)
I20260811 07:37:42.438032 17188 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.195:44083
I20260811 07:37:42.438393 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:37:42.446906 17262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.441402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42588 (local address 127.22.4.254:37447)
0811 07:37:42.441576 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.441581 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.441803 (+ 222us) server_negotiation.cc:407] Connection header received
0811 07:37:42.441915 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.441918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.441975 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.442088 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:42.442576 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.443186 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.444300 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.444622 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.444747 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.445934 (+ 1187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:42.445938 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:42.445940 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:42.445960 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:42.445991 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:42.446001 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:42.446080 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.446324 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.446640 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:37:42.451838 17188 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42588:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:37:42.455770 17188 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:37:42.479172 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.469984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46644 (local address 127.22.4.195:46073)
0811 07:37:42.471190 (+ 1206us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.471209 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.471245 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:37:42.471360 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.471369 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.471678 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.471887 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:42.472399 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.474071 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.476738 (+ 2667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.477787 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.477916 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.478174 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.478771 (+ 597us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.478969 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1049,"thread_start_us":196,"threads_started":1}
I20260811 07:37:42.479990 17961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.468743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:44385 (local address 127.0.0.1:53136)
0811 07:37:42.470665 (+ 1922us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:42.470729 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:42.470958 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:42.472597 (+ 1639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:42.472603 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:42.472626 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:42.473107 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.473122 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.475246 (+ 2124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.475251 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.476704 (+ 1453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.476716 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.478890 (+ 2174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.478895 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.479016 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.479054 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:37:42.479261 (+ 207us) client_negotiation.cc:240] Negotiation successful
0811 07:37:42.479725 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1679,"mutex_wait_us":78,"thread_start_us":130,"threads_started":1}
I20260811 07:37:42.480300 17963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.470023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53136 (local address 127.22.4.193:44385)
0811 07:37:42.471320 (+ 1297us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.471326 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.471349 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:37:42.471427 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.471431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.471678 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.471887 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:42.473470 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.475039 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.476895 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.478164 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.478389 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.478673 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.479920 (+ 1247us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.480108 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1162,"thread_start_us":188,"threads_started":1}
I20260811 07:37:42.480620 17958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.469141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:46073 (local address 127.0.0.1:46644)
0811 07:37:42.470799 (+ 1658us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:42.470818 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:42.471007 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:42.471920 (+ 913us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:42.471927 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:42.472008 (+ 81us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:42.472189 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.472196 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.474288 (+ 2092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.474292 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.476497 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.476517 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.478341 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.478346 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.478491 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.478539 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 07:37:42.479494 (+ 955us) client_negotiation.cc:240] Negotiation successful
0811 07:37:42.479689 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1561,"mutex_wait_us":1,"thread_start_us":194,"threads_started":1}
I20260811 07:37:42.484953 17830 tablet_service.cc:1467] Processing CreateTablet for tablet 2b33c6dce0a74b198d59f701d9cf2727 (DEFAULT_TABLE table=test-table [id=3f6aee06b17241fcb5a6f9b5ce7a4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:42.486260 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.468743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:44537 (local address 127.0.0.1:39748)
0811 07:37:42.472301 (+ 3558us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:42.472337 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:42.472503 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:42.476165 (+ 3662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:42.476173 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:42.476209 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:42.476343 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.476349 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.480193 (+ 3844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.480197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.481577 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.481592 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.485548 (+ 3956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.485555 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.485691 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.485733 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 07:37:42.485954 (+ 221us) client_negotiation.cc:240] Negotiation successful
0811 07:37:42.486084 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3392,"mutex_wait_us":1634,"thread_start_us":126,"threads_started":1}
I20260811 07:37:42.486398 17830 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b33c6dce0a74b198d59f701d9cf2727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:42.486459 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.469081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39748 (local address 127.22.4.194:44537)
0811 07:37:42.472444 (+ 3363us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.472463 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.472495 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:37:42.475201 (+ 2706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.475220 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.475627 (+ 407us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.475896 (+ 269us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:42.476518 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.479992 (+ 3474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.481936 (+ 1944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.485243 (+ 3307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.485457 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.485757 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.486027 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.486200 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3075,"thread_start_us":203,"threads_started":1}
I20260811 07:37:42.486984 17400 tablet_service.cc:1467] Processing CreateTablet for tablet 2b33c6dce0a74b198d59f701d9cf2727 (DEFAULT_TABLE table=test-table [id=3f6aee06b17241fcb5a6f9b5ce7a4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:42.489503 17400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b33c6dce0a74b198d59f701d9cf2727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:42.491582 17608 tablet_service.cc:1467] Processing CreateTablet for tablet 2b33c6dce0a74b198d59f701d9cf2727 (DEFAULT_TABLE table=test-table [id=3f6aee06b17241fcb5a6f9b5ce7a4a88]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:42.493177 17608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b33c6dce0a74b198d59f701d9cf2727. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:42.497061 17966 tablet_bootstrap.cc:492] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Bootstrap starting.
I20260811 07:37:42.498785 17967 tablet_bootstrap.cc:492] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6: Bootstrap starting.
I20260811 07:37:42.500842 17966 tablet_bootstrap.cc:654] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:42.501362 17967 tablet_bootstrap.cc:654] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:42.502242 17967 log.cc:824] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:42.502157 17966 log.cc:824] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:42.505000 17967 tablet_bootstrap.cc:492] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6: No bootstrap required, opened a new log
I20260811 07:37:42.504988 17971 tablet_bootstrap.cc:492] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Bootstrap starting.
I20260811 07:37:42.505403 17967 ts_tablet_manager.cc:1397] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260811 07:37:42.505625 17966 tablet_bootstrap.cc:492] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: No bootstrap required, opened a new log
I20260811 07:37:42.505843 17966 ts_tablet_manager.cc:1397] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260811 07:37:42.508065 17971 tablet_bootstrap.cc:654] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:42.509125 17971 log.cc:824] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:42.510807 17967 raft_consensus.cc:348] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.510807 17966 raft_consensus.cc:348] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.511250 17967 raft_consensus.cc:374] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:42.511250 17966 raft_consensus.cc:374] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:42.511324 17967 raft_consensus.cc:729] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a3567edb33141a480d9b544215b4bc6, State: Initialized, Role: FOLLOWER
I20260811 07:37:42.511336 17966 raft_consensus.cc:729] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b0b559d95eb4bbc9606eb88fb906038, State: Initialized, Role: FOLLOWER
I20260811 07:37:42.512058 17967 consensus_queue.cc:260] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.513008 17971 tablet_bootstrap.cc:492] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: No bootstrap required, opened a new log
I20260811 07:37:42.513408 17971 ts_tablet_manager.cc:1397] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260811 07:37:42.513228 17966 consensus_queue.cc:260] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.513906 17967 ts_tablet_manager.cc:1428] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 07:37:42.514519 17501 heartbeater.cc:503] Master 127.22.4.254:37447 was elected leader, sending a full tablet report...
I20260811 07:37:42.515036 17941 heartbeater.cc:503] Master 127.22.4.254:37447 was elected leader, sending a full tablet report...
I20260811 07:37:42.515079 17966 ts_tablet_manager.cc:1428] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260811 07:37:42.519093 17971 raft_consensus.cc:348] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.519615 17971 raft_consensus.cc:374] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:42.519690 17971 raft_consensus.cc:729] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a231f7aedc19488888e8d1dc69629ddd, State: Initialized, Role: FOLLOWER
I20260811 07:37:42.520459 17971 consensus_queue.cc:260] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.521469 17719 heartbeater.cc:503] Master 127.22.4.254:37447 was elected leader, sending a full tablet report...
I20260811 07:37:42.522063 17971 ts_tablet_manager.cc:1428] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
W20260811 07:37:42.615844 17502 tablet.cc:2369] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:42.639581 17977 raft_consensus.cc:482] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:42.639916 17977 raft_consensus.cc:504] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.641685 17977 leader_election.cc:288] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a3567edb33141a480d9b544215b4bc6 (127.22.4.193:44385), 0b0b559d95eb4bbc9606eb88fb906038 (127.22.4.195:46073)
W20260811 07:37:42.642930 17721 tablet.cc:2369] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:42.647166 17723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.642151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:46073 (local address 127.22.4.194:53025)
0811 07:37:42.642434 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:42.642455 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:42.642604 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:42.643183 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:42.643186 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:42.643213 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:42.643345 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.643353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.644333 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.644337 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.645414 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.645425 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.646534 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.646539 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.646655 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.646692 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 07:37:42.646814 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 07:37:42.646969 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 07:37:42.647287 17962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.642332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:53025 (local address 127.22.4.195:46073)
0811 07:37:42.642537 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.642542 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.642563 (+ 21us) server_negotiation.cc:407] Connection header received
0811 07:37:42.642784 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.642788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.642898 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.643010 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:42.643496 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.644161 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.645596 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.646314 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.646439 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.646496 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.646957 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.647093 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260811 07:37:42.647715 17963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.642276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:35197 (local address 127.22.4.193:44385)
0811 07:37:42.642454 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.642460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.643223 (+ 763us) server_negotiation.cc:407] Connection header received
0811 07:37:42.643447 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.643451 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.643505 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.643595 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:42.643937 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.644627 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.646191 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.646868 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.647052 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.647106 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.647429 (+ 323us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.647568 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:37:42.648234 17979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.642173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:44385 (local address 127.22.4.194:35197)
0811 07:37:42.643122 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:42.643138 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:42.643323 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:42.643610 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:42.643614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:42.643631 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:42.643818 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.643825 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.644824 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.644828 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.646017 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:42.646033 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.647072 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.647076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:42.647207 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.647237 (+ 30us) client_negotiation.cc:769] Sending connection context
0811 07:37:42.647917 (+ 680us) client_negotiation.cc:240] Negotiation successful
0811 07:37:42.648061 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":786,"mutex_wait_us":514,"thread_start_us":142,"threads_started":1}
I20260811 07:37:42.648537 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b33c6dce0a74b198d59f701d9cf2727" candidate_uuid: "a231f7aedc19488888e8d1dc69629ddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0b559d95eb4bbc9606eb88fb906038" is_pre_election: true
I20260811 07:37:42.648963 17871 raft_consensus.cc:2454] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a231f7aedc19488888e8d1dc69629ddd in term 0.
I20260811 07:37:42.649251 17430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b33c6dce0a74b198d59f701d9cf2727" candidate_uuid: "a231f7aedc19488888e8d1dc69629ddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a3567edb33141a480d9b544215b4bc6" is_pre_election: true
I20260811 07:37:42.649653 17430 raft_consensus.cc:2454] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a231f7aedc19488888e8d1dc69629ddd in term 0.
I20260811 07:37:42.649698 17537 leader_election.cc:302] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0b559d95eb4bbc9606eb88fb906038, a231f7aedc19488888e8d1dc69629ddd; no voters:
I20260811 07:37:42.650161 17977 raft_consensus.cc:2781] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:37:42.650342 17977 raft_consensus.cc:482] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:37:42.650430 17977 raft_consensus.cc:3037] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:42.652261 17977 raft_consensus.cc:504] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.652882 17977 leader_election.cc:288] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [CANDIDATE]: Term 1 election: Requested vote from peers 2a3567edb33141a480d9b544215b4bc6 (127.22.4.193:44385), 0b0b559d95eb4bbc9606eb88fb906038 (127.22.4.195:46073)
I20260811 07:37:42.653657 17430 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b33c6dce0a74b198d59f701d9cf2727" candidate_uuid: "a231f7aedc19488888e8d1dc69629ddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a3567edb33141a480d9b544215b4bc6"
I20260811 07:37:42.653599 17871 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b33c6dce0a74b198d59f701d9cf2727" candidate_uuid: "a231f7aedc19488888e8d1dc69629ddd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b0b559d95eb4bbc9606eb88fb906038"
I20260811 07:37:42.653831 17430 raft_consensus.cc:3037] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:42.653955 17871 raft_consensus.cc:3037] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:42.655517 17871 raft_consensus.cc:2454] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a231f7aedc19488888e8d1dc69629ddd in term 1.
I20260811 07:37:42.655532 17430 raft_consensus.cc:2454] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a231f7aedc19488888e8d1dc69629ddd in term 1.
I20260811 07:37:42.656044 17537 leader_election.cc:302] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b0b559d95eb4bbc9606eb88fb906038, a231f7aedc19488888e8d1dc69629ddd; no voters:
I20260811 07:37:42.656388 17977 raft_consensus.cc:2781] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:42.656693 17977 raft_consensus.cc:686] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 1 LEADER]: Becoming Leader. State: Replica: a231f7aedc19488888e8d1dc69629ddd, State: Running, Role: LEADER
I20260811 07:37:42.657229 17977 consensus_queue.cc:237] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } }
I20260811 07:37:42.662225 17188 catalog_manager.cc:5495] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd reported cstate change: term changed from 0 to 1, leader changed from <none> to a231f7aedc19488888e8d1dc69629ddd (127.22.4.194). New cstate: current_term: 1 leader_uuid: "a231f7aedc19488888e8d1dc69629ddd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a231f7aedc19488888e8d1dc69629ddd" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44537 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 } health_report { overall_health: UNKNOWN } } }
W20260811 07:37:42.666446 17942 tablet.cc:2369] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:42.681715 17959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.676285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39752 (local address 127.22.4.194:44537)
0811 07:37:42.676463 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:42.676468 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:42.676488 (+ 20us) server_negotiation.cc:407] Connection header received
0811 07:37:42.676686 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:42.676690 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:42.676779 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:42.676937 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:37:42.677339 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.677969 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.679192 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:42.679448 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:42.679551 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:42.680014 (+ 463us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:37:42.680752 (+ 738us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:37:42.680876 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:42.681251 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 07:37:42.681338 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:37:42.691583 17871 raft_consensus.cc:1261] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 1 FOLLOWER]: Refusing update from remote peer a231f7aedc19488888e8d1dc69629ddd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:42.691658 17430 raft_consensus.cc:1261] T 2b33c6dce0a74b198d59f701d9cf2727 P 2a3567edb33141a480d9b544215b4bc6 [term 1 FOLLOWER]: Refusing update from remote peer a231f7aedc19488888e8d1dc69629ddd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:42.692729 17981 consensus_queue.cc:1035] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a3567edb33141a480d9b544215b4bc6" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 44385 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:42.693246 17977 consensus_queue.cc:1035] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b0b559d95eb4bbc9606eb88fb906038" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:42.710345 17989 mvcc.cc:205] Tried to move back new op lower bound from 7317233101571706880 to 7317233101447942144. Current Snapshot: MvccSnapshot[applied={T|T < 7317233101571706880}]
I20260811 07:37:42.710345 17991 mvcc.cc:205] Tried to move back new op lower bound from 7317233101571706880 to 7317233101447942144. Current Snapshot: MvccSnapshot[applied={T|T < 7317233101571706880}]
I20260811 07:37:42.725853 17186 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:42.726212 17186 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:42.731231 17186 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f69e5d6e2fb4b1faa016fb6f64cb478: Sending DeleteTablet for 3 replicas of tablet 2b33c6dce0a74b198d59f701d9cf2727
I20260811 07:37:42.733392 17830 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b33c6dce0a74b198d59f701d9cf2727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:42 UTC) from {username='slave'} at 127.0.0.1:46644
I20260811 07:37:42.733393 17608 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b33c6dce0a74b198d59f701d9cf2727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:42 UTC) from {username='slave'} at 127.0.0.1:39748
I20260811 07:37:42.733703 17400 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b33c6dce0a74b198d59f701d9cf2727 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:42 UTC) from {username='slave'} at 127.0.0.1:53136
I20260811 07:37:42.734180 18006 tablet_replica.cc:330] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: stopping tablet replica
I20260811 07:37:42.734654 18006 raft_consensus.cc:2229] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:42.735150 18007 tablet_replica.cc:330] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: stopping tablet replica
I20260811 07:37:42.735168 18006 raft_consensus.cc:2258] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:42.735517 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 17297
I20260811 07:37:42.735901 18007 raft_consensus.cc:2229] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:37:42.746554 18006 ts_tablet_manager.cc:1905] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:42.751641 18006 ts_tablet_manager.cc:1918] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:42.751848 18006 log.cc:1196] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/2b33c6dce0a74b198d59f701d9cf2727
I20260811 07:37:42.752353 18006 ts_tablet_manager.cc:1939] T 2b33c6dce0a74b198d59f701d9cf2727 P 0b0b559d95eb4bbc9606eb88fb906038: Deleting consensus metadata
I20260811 07:37:42.757808 18007 raft_consensus.cc:2258] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:42.758489 17163 catalog_manager.cc:4841] TS 0b0b559d95eb4bbc9606eb88fb906038 (127.22.4.195:46073): tablet 2b33c6dce0a74b198d59f701d9cf2727 (table test-table [id=3f6aee06b17241fcb5a6f9b5ce7a4a88]) successfully deleted
I20260811 07:37:42.764168 18007 ts_tablet_manager.cc:1905] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:42.769218 18007 ts_tablet_manager.cc:1918] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:42.769413 18007 log.cc:1196] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/2b33c6dce0a74b198d59f701d9cf2727
I20260811 07:37:42.769852 18007 ts_tablet_manager.cc:1939] T 2b33c6dce0a74b198d59f701d9cf2727 P a231f7aedc19488888e8d1dc69629ddd: Deleting consensus metadata
I20260811 07:37:42.772378 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 17505
I20260811 07:37:42.772338 17161 catalog_manager.cc:4841] TS a231f7aedc19488888e8d1dc69629ddd (127.22.4.194:44537): tablet 2b33c6dce0a74b198d59f701d9cf2727 (table test-table [id=3f6aee06b17241fcb5a6f9b5ce7a4a88]) successfully deleted
W20260811 07:37:42.772523 17158 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:44385 (error 108)
I20260811 07:37:42.783082 17965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:42.782487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:44385 (local address 127.0.0.1:53142)
0811 07:37:42.782796 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:42.782947 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:44385: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
W20260811 07:37:42.783385 17158 catalog_manager.cc:4584] TS 2a3567edb33141a480d9b544215b4bc6 (127.22.4.193:44385): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2b33c6dce0a74b198d59f701d9cf2727: Network error: Client connection negotiation failed: client connection to 127.22.4.193:44385: connect: Connection refused (error 111)
I20260811 07:37:42.797055 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 17725
I20260811 07:37:42.824157 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 17137
2026-08-11T07:37:42Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1687 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:37:42 dist-test-slave-7z32 krb5kdc[18015](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:37:42 dist-test-slave-7z32 krb5kdc[18015](info): set up 2 sockets
Aug 11 07:37:42 dist-test-slave-7z32 krb5kdc[18015](info): commencing operation
krb5kdc: starting...
W20260811 07:37:44.300206 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.434s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:37:44 dist-test-slave-7z32 krb5kdc[18015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:37:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:37:44.508960 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:35777
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:35777
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:44.714933 18039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:44.715392 18039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:44.715445 18039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:44.721598 18039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:44.721765 18039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:44.721791 18039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:44.721812 18039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:44.721829 18039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:44.730293 18039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:35777
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:35777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:44.732764 18039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:44.735193 18039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:44.749091 18046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:44.749353 18039 server_base.cc:1034] running on GCE node
W20260811 07:37:44.749104 18051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:44.749104 18049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:44.750984 18039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:44.752908 18039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:44.754233 18039 hybrid_clock.cc:648] HybridClock initialized: now 1786433864754188 us; error 78 us; skew 500 ppm
Aug 11 07:37:44 dist-test-slave-7z32 krb5kdc[18015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433864, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:44.766424 18039 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:37:44.769001 18039 webserver.cc:460] Webserver started at http://127.22.4.254:34353/ using document root <none> and password file <none>
I20260811 07:37:44.770085 18039 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:44.770278 18039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:44.770606 18039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:44.773784 18039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "8f19bcbedfdb4165a373367597300fa3"
format_stamp: "Formatted at 2026-08-11 07:37:44 on dist-test-slave-7z32"
server_key: "95623b69100e20608a36de15993c800f"
server_key_iv: "6c07f7e1254ece3862002f2b69e91cc2"
server_key_version: "encryptionkey@0"
I20260811 07:37:44.774659 18039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "8f19bcbedfdb4165a373367597300fa3"
format_stamp: "Formatted at 2026-08-11 07:37:44 on dist-test-slave-7z32"
server_key: "95623b69100e20608a36de15993c800f"
server_key_iv: "6c07f7e1254ece3862002f2b69e91cc2"
server_key_version: "encryptionkey@0"
I20260811 07:37:44.780901 18039 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s
I20260811 07:37:44.785297 18063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:44.787838 18039 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 07:37:44.788167 18039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "8f19bcbedfdb4165a373367597300fa3"
format_stamp: "Formatted at 2026-08-11 07:37:44 on dist-test-slave-7z32"
server_key: "95623b69100e20608a36de15993c800f"
server_key_iv: "6c07f7e1254ece3862002f2b69e91cc2"
server_key_version: "encryptionkey@0"
I20260811 07:37:44.788425 18039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:44.815506 18039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:44.820497 18039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:44.820820 18039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:44.831957 18039 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:35777
I20260811 07:37:44.832039 18150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:35777 every 8 connection(s)
I20260811 07:37:44.833423 18039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:44.836230 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 18039
I20260811 07:37:44.836416 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:44.836792 22547 external_mini_cluster.cc:1428] Setting key bf4811433a240a4aa01cf43fb316aa25
I20260811 07:37:44.837921 18153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:44.846376 18153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3: Bootstrap starting.
Aug 11 07:37:44 dist-test-slave-7z32 krb5kdc[18015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433864, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:44.849892 18153 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:44.850894 18153 log.cc:824] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:44.853515 18153 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3: No bootstrap required, opened a new log
I20260811 07:37:44.857924 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:44.838981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52712 (local address 127.22.4.254:35777)
0811 07:37:44.839603 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:44.839624 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:44.839677 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:37:44.840555 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:44.840577 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:44.841138 (+ 561us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:44.841527 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:44.842685 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:44.844031 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:44.845456 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:44.846282 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:44.846585 (+ 303us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:44.850399 (+ 3814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:44.850408 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:44.850436 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:44.850494 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:44.852931 (+ 2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:44.853636 (+ 705us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:44.853644 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:44.853672 (+ 28us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:44.853885 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:44.854248 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:44.854252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:44.854254 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:44.855004 (+ 750us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:44.855271 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:44.855685 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 07:37:44.856659 (+ 974us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":187,"threads_started":1}
I20260811 07:37:44.859321 18153 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f19bcbedfdb4165a373367597300fa3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35777 } }
I20260811 07:37:44.859740 18153 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:44.859853 18153 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f19bcbedfdb4165a373367597300fa3, State: Initialized, Role: FOLLOWER
I20260811 07:37:44.860599 18153 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f19bcbedfdb4165a373367597300fa3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35777 } }
I20260811 07:37:44.860828 18153 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:44.860896 18153 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:44.861017 18153 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:44.862464 18153 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f19bcbedfdb4165a373367597300fa3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35777 } }
I20260811 07:37:44.863021 18153 leader_election.cc:302] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8f19bcbedfdb4165a373367597300fa3; no voters:
I20260811 07:37:44.863432 18153 leader_election.cc:288] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:44.864315 18158 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:44.864990 18158 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [term 1 LEADER]: Becoming Leader. State: Replica: 8f19bcbedfdb4165a373367597300fa3, State: Running, Role: LEADER
I20260811 07:37:44.865391 18153 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:44.865834 18158 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f19bcbedfdb4165a373367597300fa3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35777 } }
I20260811 07:37:44.869928 18159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8f19bcbedfdb4165a373367597300fa3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f19bcbedfdb4165a373367597300fa3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35777 } } }
I20260811 07:37:44.870318 18160 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f19bcbedfdb4165a373367597300fa3. Latest consensus state: current_term: 1 leader_uuid: "8f19bcbedfdb4165a373367597300fa3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8f19bcbedfdb4165a373367597300fa3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 35777 } } }
I20260811 07:37:44.870709 18159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:44.870874 18160 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3 [sys.catalog]: This master's current role is: LEADER
W20260811 07:37:44.875496 18182 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:37:44.875705 18182 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:37:44.875995 18184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:44.878191 18184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:44.890230 18184 catalog_manager.cc:1347] Generated new cluster ID: b5036db015de4d91a179b1f98c827d3e
I20260811 07:37:44.890420 18184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:44.908916 18184 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:44.910531 18184 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:44.923502 18184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3: Generated new TSK 0
I20260811 07:37:44.924862 18184 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:37:44.976120 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35777
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:45.154645 18190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:45.155092 18190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:45.155190 18190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:45.159848 18190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:45.159962 18190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:45.160072 18190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:37:45.167375 18190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:45.169202 18190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:45.171144 18190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:45.185544 18204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:45.185592 18201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:45.185592 18200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:45.185883 18190 server_base.cc:1034] running on GCE node
I20260811 07:37:45.186702 18190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:45.187633 18190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:45.188928 18190 hybrid_clock.cc:648] HybridClock initialized: now 1786433865188893 us; error 61 us; skew 500 ppm
Aug 11 07:37:45 dist-test-slave-7z32 krb5kdc[18015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433865, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:45.192744 18190 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:37:45.193897 18190 webserver.cc:460] Webserver started at http://127.22.4.193:44881/ using document root <none> and password file <none>
I20260811 07:37:45.194613 18190 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:45.194717 18190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:45.195036 18190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:45.197516 18190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "8dbbc1cb37114756b172ae5f46daa4e1"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "5585e082d3b792d323a984e9928f7515"
server_key_iv: "184098f9d5bc49be0da672c87373c282"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.198204 18190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "8dbbc1cb37114756b172ae5f46daa4e1"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "5585e082d3b792d323a984e9928f7515"
server_key_iv: "184098f9d5bc49be0da672c87373c282"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.203418 18190 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:37:45.207157 18220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.209293 18190 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:37:45.209513 18190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "8dbbc1cb37114756b172ae5f46daa4e1"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "5585e082d3b792d323a984e9928f7515"
server_key_iv: "184098f9d5bc49be0da672c87373c282"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.209699 18190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:45.239230 18190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:45.243330 18190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:45.243621 18190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:45.244400 18190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:45.245469 18190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:45.245549 18190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.245653 18190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:45.245700 18190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.258378 18190 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:34707
I20260811 07:37:45.258488 18407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:34707 every 8 connection(s)
I20260811 07:37:45.259721 18190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:37:45.261090 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 18190
I20260811 07:37:45.261270 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:37:45.261643 22547 external_mini_cluster.cc:1428] Setting key 7fafcaa8f99db8f90983aec3b8a55f3f
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
Aug 11 07:37:45 dist-test-slave-7z32 krb5kdc[18015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433865, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:37:45.287387 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.262613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:41345 (local address 127.22.4.254:35777)
0811 07:37:45.262811 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:45.262818 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:45.266531 (+ 3713us) server_negotiation.cc:407] Connection header received
0811 07:37:45.268968 (+ 2437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:45.268975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:45.269143 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:45.269347 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:45.271928 (+ 2581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.272907 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.274717 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.275393 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.275612 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.279813 (+ 4201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:45.279817 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:45.279820 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:45.279864 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:45.282654 (+ 2790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:45.284225 (+ 1571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:45.284230 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:45.284232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:45.284410 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:45.285120 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:45.285123 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:45.285124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:45.285388 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:45.285518 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:45.286650 (+ 1132us) server_negotiation.cc:299] Negotiation successful
0811 07:37:45.286917 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:37:45.288353 18414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.263230 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35777 (local address 127.22.4.193:41345)
0811 07:37:45.266115 (+ 2885us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:45.266229 (+ 114us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:45.268386 (+ 2157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:45.269854 (+ 1468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:45.269871 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:45.270746 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:45.271629 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.271652 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.273247 (+ 1595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.273252 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.274469 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.274485 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.275698 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.275704 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.275977 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.276940 (+ 963us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:45.276972 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:45.279220 (+ 2248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:45.283022 (+ 3802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:45.283037 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:45.283082 (+ 45us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:45.283898 (+ 816us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:45.284573 (+ 675us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:45.284577 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:45.284579 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:45.284919 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:45.285540 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:45.285554 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:45.286198 (+ 644us) client_negotiation.cc:769] Sending connection context
0811 07:37:45.286465 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 07:37:45.287003 (+ 538us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2588,"thread_start_us":700,"threads_started":1}
I20260811 07:37:45.290545 18409 heartbeater.cc:347] Connected to a master server at 127.22.4.254:35777
I20260811 07:37:45.290967 18409 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:45.291723 18409 heartbeater.cc:511] Master 127.22.4.254:35777 requested a full tablet report, sending...
I20260811 07:37:45.294051 18082 ts_manager.cc:194] Registered new tserver with Master: 8dbbc1cb37114756b172ae5f46daa4e1 (127.22.4.193:34707)
I20260811 07:37:45.295727 18082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:41345
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:37:45.307716 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35777
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:45.459888 18417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:45.460390 18417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:45.460446 18417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:45.464957 18417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:45.465119 18417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:45.465217 18417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:37:45.471594 18417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:45.472937 18417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:45.474140 18417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:45.487121 18432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:45.487378 18424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:45.487121 18429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:45.488596 18417 server_base.cc:1034] running on GCE node
I20260811 07:37:45.489611 18417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:45.490703 18417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:45.494369 18417 hybrid_clock.cc:648] HybridClock initialized: now 1786433865494276 us; error 89 us; skew 500 ppm
Aug 11 07:37:45 dist-test-slave-7z32 krb5kdc[18015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433865, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:45.500113 18417 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:37:45.501726 18417 webserver.cc:460] Webserver started at http://127.22.4.194:45385/ using document root <none> and password file <none>
I20260811 07:37:45.502628 18417 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:45.502753 18417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:45.503129 18417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:45.506181 18417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "e3da9523781c4508a0cd561d27e95334"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "e7c77e6697359c858f7d1a5498382d18"
server_key_iv: "2408acef88a1bdbf6d691447dd5409c1"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.507124 18417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "e3da9523781c4508a0cd561d27e95334"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "e7c77e6697359c858f7d1a5498382d18"
server_key_iv: "2408acef88a1bdbf6d691447dd5409c1"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.514130 18417 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:37:45.519421 18445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.521647 18417 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:37:45.521955 18417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "e3da9523781c4508a0cd561d27e95334"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "e7c77e6697359c858f7d1a5498382d18"
server_key_iv: "2408acef88a1bdbf6d691447dd5409c1"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.522161 18417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:45.553015 18417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:45.557816 18417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:45.558120 18417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:45.559120 18417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:45.560359 18417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:45.560438 18417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.560523 18417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:45.560565 18417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.576937 18417 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:38889
I20260811 07:37:45.577099 18641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:38889 every 8 connection(s)
I20260811 07:37:45.578465 18417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:37:45.581776 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 18417
I20260811 07:37:45.581919 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:37:45.582305 22547 external_mini_cluster.cc:1428] Setting key cded544cbd1fb6afa557307eb2120732
Aug 11 07:37:45 dist-test-slave-7z32 krb5kdc[18015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433865, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:37:45.601523 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.582388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:40271 (local address 127.22.4.254:35777)
0811 07:37:45.582659 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:45.582667 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:45.584175 (+ 1508us) server_negotiation.cc:407] Connection header received
0811 07:37:45.586392 (+ 2217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:45.586396 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:45.586459 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:45.586569 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:45.588459 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.589043 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.590372 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.590623 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.590747 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.594718 (+ 3971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:45.594727 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:45.594730 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:45.594766 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:45.597072 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:45.598527 (+ 1455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:45.598531 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:45.598533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:45.598657 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:45.599454 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:45.599458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:45.599460 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:45.599766 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:45.599910 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:45.601119 (+ 1209us) server_negotiation.cc:299] Negotiation successful
0811 07:37:45.601326 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:37:45.602955 18649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.583033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35777 (local address 127.22.4.194:40271)
0811 07:37:45.583931 (+ 898us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:45.584008 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:45.586049 (+ 2041us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:45.586886 (+ 837us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:45.586900 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:45.587565 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:45.588228 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.588245 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.589204 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.589207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.590211 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.590222 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.590809 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.590813 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.591128 (+ 315us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.592028 (+ 900us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:45.592049 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:45.594449 (+ 2400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:45.597511 (+ 3062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:45.597529 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:45.597551 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:45.598187 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:45.598855 (+ 668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:45.598862 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:45.598865 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:45.599256 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:45.599927 (+ 671us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:45.599937 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:45.600492 (+ 555us) client_negotiation.cc:769] Sending connection context
0811 07:37:45.601037 (+ 545us) client_negotiation.cc:240] Negotiation successful
0811 07:37:45.601593 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":268,"threads_started":1}
I20260811 07:37:45.604926 18642 heartbeater.cc:347] Connected to a master server at 127.22.4.254:35777
I20260811 07:37:45.605480 18642 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:45.606513 18642 heartbeater.cc:511] Master 127.22.4.254:35777 requested a full tablet report, sending...
I20260811 07:37:45.608748 18082 ts_manager.cc:194] Registered new tserver with Master: e3da9523781c4508a0cd561d27e95334 (127.22.4.194:38889)
I20260811 07:37:45.609889 18082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:40271
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:37:45.628945 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35777
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:38871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:45.795428 18652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:45.795935 18652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:45.796034 18652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:45.802095 18652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:45.802241 18652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:45.802325 18652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:37:45.809600 18652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:38871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:35777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:45.812096 18652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:45.814345 18652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:45.828948 18662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:45.829216 18652 server_base.cc:1034] running on GCE node
W20260811 07:37:45.828943 18657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:45.828948 18658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:45.830120 18652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:45.831218 18652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:45.834612 18652 hybrid_clock.cc:648] HybridClock initialized: now 1786433865834559 us; error 57 us; skew 500 ppm
Aug 11 07:37:45 dist-test-slave-7z32 krb5kdc[18015](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433865, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:45.839649 18652 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:37:45.841032 18652 webserver.cc:460] Webserver started at http://127.22.4.195:40045/ using document root <none> and password file <none>
I20260811 07:37:45.841820 18652 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:45.841943 18652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:45.842234 18652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:45.845533 18652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "245a82e6b3b4423fb619f99952785993"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "3c2ba7275640e0cd70eaba0ba7c03472"
server_key_iv: "2312b8b1d0a92361c705c10eefb6fe4e"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.846356 18652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "245a82e6b3b4423fb619f99952785993"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "3c2ba7275640e0cd70eaba0ba7c03472"
server_key_iv: "2312b8b1d0a92361c705c10eefb6fe4e"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.852797 18652 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260811 07:37:45.858073 18670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.861327 18652 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.003s sys 0.000s
I20260811 07:37:45.861613 18652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "245a82e6b3b4423fb619f99952785993"
format_stamp: "Formatted at 2026-08-11 07:37:45 on dist-test-slave-7z32"
server_key: "3c2ba7275640e0cd70eaba0ba7c03472"
server_key_iv: "2312b8b1d0a92361c705c10eefb6fe4e"
server_key_version: "encryptionkey@0"
I20260811 07:37:45.861805 18652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:45.880931 18652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:45.886765 18652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:45.887451 18652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:45.888746 18652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:45.890007 18652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:45.890108 18652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.890187 18652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:45.890229 18652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:45.904886 18652 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:46593
I20260811 07:37:45.904973 18871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:46593 every 8 connection(s)
I20260811 07:37:45.906317 18652 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:37:45.913165 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 18652
I20260811 07:37:45.913352 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:37:45.913854 22547 external_mini_cluster.cc:1428] Setting key 16018d0d7c6acae75ac090218dea1e58
Aug 11 07:37:45 dist-test-slave-7z32 krb5kdc[18015](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433865, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:45.928848 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.909599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:42955 (local address 127.22.4.254:35777)
0811 07:37:45.909769 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:45.909773 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:45.911252 (+ 1479us) server_negotiation.cc:407] Connection header received
0811 07:37:45.913177 (+ 1925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:45.913195 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:45.913328 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:45.913511 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:45.915867 (+ 2356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.916555 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.918150 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.918457 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.918606 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.922469 (+ 3863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:45.922473 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:45.922476 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:45.922520 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:45.924640 (+ 2120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:45.925750 (+ 1110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:45.925754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:45.925756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:45.925907 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:45.926659 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:45.926662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:45.926663 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:45.927188 (+ 525us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:45.927352 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:45.928391 (+ 1039us) server_negotiation.cc:299] Negotiation successful
0811 07:37:45.928634 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:37:45.930200 18878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.910019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:35777 (local address 127.22.4.195:42955)
0811 07:37:45.911011 (+ 992us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:45.911092 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:45.912720 (+ 1628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:45.913917 (+ 1197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:45.913929 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:45.914599 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:45.915621 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.915646 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.916756 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.916760 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.917970 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.917985 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.918696 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.918701 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.918989 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.919880 (+ 891us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:45.919904 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:45.922118 (+ 2214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:45.924918 (+ 2800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:45.924928 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:45.924954 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:45.925414 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:45.926200 (+ 786us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:45.926204 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:45.926206 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:45.926469 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:45.927368 (+ 899us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:45.927377 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:45.927861 (+ 484us) client_negotiation.cc:769] Sending connection context
0811 07:37:45.928181 (+ 320us) client_negotiation.cc:240] Negotiation successful
0811 07:37:45.928713 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"thread_start_us":234,"threads_started":1}
I20260811 07:37:45.932128 18872 heartbeater.cc:347] Connected to a master server at 127.22.4.254:35777
I20260811 07:37:45.932492 18872 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:45.933305 18872 heartbeater.cc:511] Master 127.22.4.254:35777 requested a full tablet report, sending...
I20260811 07:37:45.935050 18082 ts_manager.cc:194] Registered new tserver with Master: 245a82e6b3b4423fb619f99952785993 (127.22.4.195:46593)
I20260811 07:37:45.935820 18082 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:42955
I20260811 07:37:45.943715 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:37:45.958070 18156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.946913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52722 (local address 127.22.4.254:35777)
0811 07:37:45.947137 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:45.947143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:45.947422 (+ 279us) server_negotiation.cc:407] Connection header received
0811 07:37:45.947633 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:45.947642 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:45.947703 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:45.947809 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:45.948770 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.949434 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.950470 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.950882 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.951034 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.953684 (+ 2650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:45.953689 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:45.953698 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:45.953746 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:45.955632 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:45.956431 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:45.956435 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:45.956437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:45.956534 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:45.956923 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:45.956927 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:45.956929 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:45.957215 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:45.957417 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:45.957708 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 07:37:45.957840 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:37:45.963961 18082 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52722:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:37:45.969427 18082 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:37:45.994752 18897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.986522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53862 (local address 127.22.4.194:38889)
0811 07:37:45.987255 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:45.987272 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:45.987461 (+ 189us) server_negotiation.cc:407] Connection header received
0811 07:37:45.987779 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:45.987786 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:45.988111 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:45.988293 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:45.989005 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.990204 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.992733 (+ 2529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.993461 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.993641 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.993859 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:45.994403 (+ 544us) server_negotiation.cc:299] Negotiation successful
0811 07:37:45.994554 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":196,"threads_started":1}
I20260811 07:37:45.995570 18893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.985902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60708 (local address 127.22.4.195:46593)
0811 07:37:45.987494 (+ 1592us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:45.987507 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:45.987546 (+ 39us) server_negotiation.cc:407] Connection header received
0811 07:37:45.987791 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:45.987797 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:45.988111 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:45.988293 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:45.988785 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.990188 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.992730 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.993856 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.994005 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.994228 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:45.995252 (+ 1024us) server_negotiation.cc:299] Negotiation successful
0811 07:37:45.995395 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1475,"thread_start_us":180,"threads_started":1}
I20260811 07:37:45.996076 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.985766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:46593 (local address 127.0.0.1:60708)
0811 07:37:45.987191 (+ 1425us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:45.987295 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:45.987506 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:45.988330 (+ 824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:45.988338 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:45.988364 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:45.988594 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.988605 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.990411 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.990416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.992497 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.992519 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.994360 (+ 1841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.994364 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.994504 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.994540 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 07:37:45.994623 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 07:37:45.995915 (+ 1292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1028,"mutex_wait_us":284,"thread_start_us":169,"threads_started":1}
I20260811 07:37:45.996426 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.986873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:34707 (local address 127.0.0.1:50542)
0811 07:37:45.987862 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:45.987876 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:45.988048 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:45.989050 (+ 1002us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:45.989053 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:45.989074 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:45.989174 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.989183 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.991205 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.991213 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.992565 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.992583 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.994905 (+ 2322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.994909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.996011 (+ 1102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.996044 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 07:37:45.996151 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 07:37:45.996258 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"mutex_wait_us":1000,"thread_start_us":124,"threads_started":1}
I20260811 07:37:45.996426 18899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.986275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:38889 (local address 127.0.0.1:53862)
0811 07:37:45.987191 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:45.987295 (+ 104us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:45.987551 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:45.988594 (+ 1043us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:45.988597 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:45.988616 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:45.988788 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.988799 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.990411 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.990416 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.992497 (+ 2081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:45.992519 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.993659 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.993664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:45.994121 (+ 457us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.994173 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 07:37:45.995013 (+ 840us) client_negotiation.cc:240] Negotiation successful
0811 07:37:45.996072 (+ 1059us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":824,"mutex_wait_us":1155,"thread_start_us":179,"threads_started":1}
I20260811 07:37:45.996914 18901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:45.987410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50542 (local address 127.22.4.193:34707)
0811 07:37:45.987749 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:45.987756 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:45.987999 (+ 243us) server_negotiation.cc:407] Connection header received
0811 07:37:45.988227 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:45.988258 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:45.988556 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:45.988751 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:45.989358 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.991001 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.992807 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:45.994403 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:45.994556 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:45.994727 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:45.996393 (+ 1666us) server_negotiation.cc:299] Negotiation successful
0811 07:37:45.996745 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":135,"threads_started":1}
I20260811 07:37:46.000764 18533 tablet_service.cc:1467] Processing CreateTablet for tablet 83e851c794424c9da1727ebf5df2af2e (DEFAULT_TABLE table=test-table [id=241a5bc8bfda475cbc7af7df4840d059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:46.001204 18301 tablet_service.cc:1467] Processing CreateTablet for tablet 83e851c794424c9da1727ebf5df2af2e (DEFAULT_TABLE table=test-table [id=241a5bc8bfda475cbc7af7df4840d059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:46.001202 18758 tablet_service.cc:1467] Processing CreateTablet for tablet 83e851c794424c9da1727ebf5df2af2e (DEFAULT_TABLE table=test-table [id=241a5bc8bfda475cbc7af7df4840d059]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:46.002130 18533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e851c794424c9da1727ebf5df2af2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:46.002583 18301 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e851c794424c9da1727ebf5df2af2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:46.002583 18758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83e851c794424c9da1727ebf5df2af2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:46.012243 18904 tablet_bootstrap.cc:492] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1: Bootstrap starting.
I20260811 07:37:46.012676 18902 tablet_bootstrap.cc:492] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Bootstrap starting.
I20260811 07:37:46.013409 18903 tablet_bootstrap.cc:492] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: Bootstrap starting.
I20260811 07:37:46.015378 18904 tablet_bootstrap.cc:654] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:46.015839 18902 tablet_bootstrap.cc:654] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:46.016464 18903 tablet_bootstrap.cc:654] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:46.016535 18904 log.cc:824] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:46.016609 18902 log.cc:824] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:46.017524 18903 log.cc:824] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:46.019354 18902 tablet_bootstrap.cc:492] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: No bootstrap required, opened a new log
I20260811 07:37:46.019624 18902 ts_tablet_manager.cc:1397] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260811 07:37:46.019822 18904 tablet_bootstrap.cc:492] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1: No bootstrap required, opened a new log
I20260811 07:37:46.020131 18903 tablet_bootstrap.cc:492] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: No bootstrap required, opened a new log
I20260811 07:37:46.020219 18904 ts_tablet_manager.cc:1397] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260811 07:37:46.020393 18903 ts_tablet_manager.cc:1397] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260811 07:37:46.024101 18903 raft_consensus.cc:348] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.024497 18903 raft_consensus.cc:374] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:46.024562 18903 raft_consensus.cc:729] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 245a82e6b3b4423fb619f99952785993, State: Initialized, Role: FOLLOWER
I20260811 07:37:46.024402 18902 raft_consensus.cc:348] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.024760 18902 raft_consensus.cc:374] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:46.024905 18902 raft_consensus.cc:729] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3da9523781c4508a0cd561d27e95334, State: Initialized, Role: FOLLOWER
I20260811 07:37:46.025080 18904 raft_consensus.cc:348] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.025238 18903 consensus_queue.cc:260] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.025353 18904 raft_consensus.cc:374] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:46.025405 18904 raft_consensus.cc:729] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dbbc1cb37114756b172ae5f46daa4e1, State: Initialized, Role: FOLLOWER
I20260811 07:37:46.025506 18902 consensus_queue.cc:260] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.025805 18904 consensus_queue.cc:260] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.026522 18642 heartbeater.cc:503] Master 127.22.4.254:35777 was elected leader, sending a full tablet report...
I20260811 07:37:46.026670 18903 ts_tablet_manager.cc:1428] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260811 07:37:46.026789 18904 ts_tablet_manager.cc:1428] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1: Time spent starting tablet: real 0.006s user 0.002s sys 0.004s
I20260811 07:37:46.026789 18902 ts_tablet_manager.cc:1428] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260811 07:37:46.027091 18872 heartbeater.cc:503] Master 127.22.4.254:35777 was elected leader, sending a full tablet report...
I20260811 07:37:46.027278 18409 heartbeater.cc:503] Master 127.22.4.254:35777 was elected leader, sending a full tablet report...
W20260811 07:37:46.080806 18644 tablet.cc:2369] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:46.081786 18910 raft_consensus.cc:482] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:46.082034 18910 raft_consensus.cc:504] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.083592 18910 leader_election.cc:288] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dbbc1cb37114756b172ae5f46daa4e1 (127.22.4.193:34707), e3da9523781c4508a0cd561d27e95334 (127.22.4.194:38889)
I20260811 07:37:46.090083 18901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.084206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:53013 (local address 127.22.4.193:34707)
0811 07:37:46.084434 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:46.084440 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:46.084462 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:37:46.084519 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:46.084522 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:46.084570 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:46.084676 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:46.085224 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.086042 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.088134 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.088899 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.089079 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:46.089144 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:46.089806 (+ 662us) server_negotiation.cc:299] Negotiation successful
0811 07:37:46.089950 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260811 07:37:46.090083 18897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.084539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:48913 (local address 127.22.4.194:38889)
0811 07:37:46.084725 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:46.084730 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:46.084996 (+ 266us) server_negotiation.cc:407] Connection header received
0811 07:37:46.085235 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:46.085239 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:46.085319 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:46.085441 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:46.085804 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.086410 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.088134 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.088898 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.089079 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:46.089144 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:46.089808 (+ 664us) server_negotiation.cc:299] Negotiation successful
0811 07:37:46.089914 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260811 07:37:46.090178 18878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.083892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:34707 (local address 127.22.4.195:53013)
0811 07:37:46.084046 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:46.084065 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:46.084180 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:46.084760 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:46.084765 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:46.084806 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:46.085041 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:46.085053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.086207 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.086210 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:46.087836 (+ 1626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:46.087855 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.089127 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.089132 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:46.089450 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:46.089596 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 07:37:46.089710 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 07:37:46.089914 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":157}
I20260811 07:37:46.090530 18918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.084188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:38889 (local address 127.22.4.195:48913)
0811 07:37:46.084815 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:46.084835 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:46.084997 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:46.085502 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:46.085505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:46.085527 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:46.085652 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:46.085657 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.086532 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.086536 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:46.087935 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:46.087947 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.089163 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.089167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:46.089450 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:46.089596 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 07:37:46.089711 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:37:46.089914 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"mutex_wait_us":138,"thread_start_us":218,"threads_started":1}
I20260811 07:37:46.091179 18330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e851c794424c9da1727ebf5df2af2e" candidate_uuid: "245a82e6b3b4423fb619f99952785993" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" is_pre_election: true
I20260811 07:37:46.091627 18330 raft_consensus.cc:2454] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245a82e6b3b4423fb619f99952785993 in term 0.
I20260811 07:37:46.091542 18567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e851c794424c9da1727ebf5df2af2e" candidate_uuid: "245a82e6b3b4423fb619f99952785993" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3da9523781c4508a0cd561d27e95334" is_pre_election: true
I20260811 07:37:46.092025 18567 raft_consensus.cc:2454] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 245a82e6b3b4423fb619f99952785993 in term 0.
I20260811 07:37:46.092401 18680 leader_election.cc:302] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245a82e6b3b4423fb619f99952785993, 8dbbc1cb37114756b172ae5f46daa4e1; no voters:
I20260811 07:37:46.092811 18910 raft_consensus.cc:2781] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:37:46.093032 18910 raft_consensus.cc:482] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:37:46.093109 18910 raft_consensus.cc:3037] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:46.094746 18910 raft_consensus.cc:504] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.095398 18910 leader_election.cc:288] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [CANDIDATE]: Term 1 election: Requested vote from peers 8dbbc1cb37114756b172ae5f46daa4e1 (127.22.4.193:34707), e3da9523781c4508a0cd561d27e95334 (127.22.4.194:38889)
I20260811 07:37:46.096165 18330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e851c794424c9da1727ebf5df2af2e" candidate_uuid: "245a82e6b3b4423fb619f99952785993" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dbbc1cb37114756b172ae5f46daa4e1"
I20260811 07:37:46.096166 18567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83e851c794424c9da1727ebf5df2af2e" candidate_uuid: "245a82e6b3b4423fb619f99952785993" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3da9523781c4508a0cd561d27e95334"
I20260811 07:37:46.096429 18567 raft_consensus.cc:3037] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:46.096396 18330 raft_consensus.cc:3037] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:46.098096 18567 raft_consensus.cc:2454] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245a82e6b3b4423fb619f99952785993 in term 1.
I20260811 07:37:46.098096 18330 raft_consensus.cc:2454] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 245a82e6b3b4423fb619f99952785993 in term 1.
I20260811 07:37:46.098654 18675 leader_election.cc:302] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 245a82e6b3b4423fb619f99952785993, e3da9523781c4508a0cd561d27e95334; no voters:
I20260811 07:37:46.098981 18910 raft_consensus.cc:2781] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:46.099375 18910 raft_consensus.cc:686] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 1 LEADER]: Becoming Leader. State: Replica: 245a82e6b3b4423fb619f99952785993, State: Running, Role: LEADER
I20260811 07:37:46.099946 18910 consensus_queue.cc:237] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } }
I20260811 07:37:46.105809 18090 catalog_manager.cc:5495] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 reported cstate change: term changed from 0 to 1, leader changed from <none> to 245a82e6b3b4423fb619f99952785993 (127.22.4.195). New cstate: current_term: 1 leader_uuid: "245a82e6b3b4423fb619f99952785993" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "245a82e6b3b4423fb619f99952785993" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 46593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 } health_report { overall_health: UNKNOWN } } }
I20260811 07:37:46.130625 18893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.125544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60710 (local address 127.22.4.195:46593)
0811 07:37:46.125703 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:46.125707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:46.125725 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:37:46.125825 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:46.125829 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:46.125908 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:46.126055 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:37:46.126567 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.127320 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.128650 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.128904 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.129030 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:46.129493 (+ 463us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:37:46.130031 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:37:46.130166 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:46.130335 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 07:37:46.130434 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:37:46.139365 18567 raft_consensus.cc:1261] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 1 FOLLOWER]: Refusing update from remote peer 245a82e6b3b4423fb619f99952785993: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:46.139398 18330 raft_consensus.cc:1261] T 83e851c794424c9da1727ebf5df2af2e P 8dbbc1cb37114756b172ae5f46daa4e1 [term 1 FOLLOWER]: Refusing update from remote peer 245a82e6b3b4423fb619f99952785993: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:46.140669 18919 consensus_queue.cc:1035] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dbbc1cb37114756b172ae5f46daa4e1" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 34707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:46.140969 18910 consensus_queue.cc:1035] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3da9523781c4508a0cd561d27e95334" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 38889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:46.153206 18927 mvcc.cc:205] Tried to move back new op lower bound from 7317233115694657536 to 7317233115550822400. Current Snapshot: MvccSnapshot[applied={T|T < 7317233115694657536}]
I20260811 07:37:46.153601 18926 mvcc.cc:205] Tried to move back new op lower bound from 7317233115694657536 to 7317233115550822400. Current Snapshot: MvccSnapshot[applied={T|T < 7317233115694657536}]
I20260811 07:37:46.167047 18090 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:46.167304 18090 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52722:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:46.172032 18090 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8f19bcbedfdb4165a373367597300fa3: Sending DeleteTablet for 3 replicas of tablet 83e851c794424c9da1727ebf5df2af2e
I20260811 07:37:46.173491 18533 tablet_service.cc:1514] Processing DeleteTablet for tablet 83e851c794424c9da1727ebf5df2af2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:46 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:53862
I20260811 07:37:46.173493 18758 tablet_service.cc:1514] Processing DeleteTablet for tablet 83e851c794424c9da1727ebf5df2af2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:46 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:60708
I20260811 07:37:46.173493 18301 tablet_service.cc:1514] Processing DeleteTablet for tablet 83e851c794424c9da1727ebf5df2af2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:46 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:50542
I20260811 07:37:46.174432 18940 tablet_replica.cc:330] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: stopping tablet replica
I20260811 07:37:46.174539 18942 tablet_replica.cc:330] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: stopping tablet replica
I20260811 07:37:46.175038 18942 raft_consensus.cc:2229] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:37:46.175040 18940 raft_consensus.cc:2229] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:46.175546 18940 raft_consensus.cc:2258] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:46.175745 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 18190
I20260811 07:37:46.186297 18940 ts_tablet_manager.cc:1905] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:46.193260 18940 ts_tablet_manager.cc:1918] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:46.193537 18940 log.cc:1196] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/83e851c794424c9da1727ebf5df2af2e
I20260811 07:37:46.194321 18940 ts_tablet_manager.cc:1939] T 83e851c794424c9da1727ebf5df2af2e P e3da9523781c4508a0cd561d27e95334: Deleting consensus metadata
I20260811 07:37:46.205233 18068 catalog_manager.cc:4841] TS e3da9523781c4508a0cd561d27e95334 (127.22.4.194:38889): tablet 83e851c794424c9da1727ebf5df2af2e (table test-table [id=241a5bc8bfda475cbc7af7df4840d059]) successfully deleted
I20260811 07:37:46.206323 18942 raft_consensus.cc:2258] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:46.208724 18942 ts_tablet_manager.cc:1905] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:46.212700 18942 ts_tablet_manager.cc:1918] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:46.212915 18942 log.cc:1196] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/83e851c794424c9da1727ebf5df2af2e
I20260811 07:37:46.213359 18942 ts_tablet_manager.cc:1939] T 83e851c794424c9da1727ebf5df2af2e P 245a82e6b3b4423fb619f99952785993: Deleting consensus metadata
I20260811 07:37:46.215536 18069 catalog_manager.cc:4841] TS 245a82e6b3b4423fb619f99952785993 (127.22.4.195:46593): tablet 83e851c794424c9da1727ebf5df2af2e (table test-table [id=241a5bc8bfda475cbc7af7df4840d059]) successfully deleted
I20260811 07:37:46.216096 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 18417
W20260811 07:37:46.216063 18069 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:34707 (error 108)
I20260811 07:37:46.224339 18896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.223867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:34707 (local address 127.0.0.1:50548)
0811 07:37:46.224050 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:46.224167 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:34707: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260811 07:37:46.224642 18069 catalog_manager.cc:4584] TS 8dbbc1cb37114756b172ae5f46daa4e1 (127.22.4.193:34707): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83e851c794424c9da1727ebf5df2af2e: Network error: Client connection negotiation failed: client connection to 127.22.4.193:34707: connect: Connection refused (error 111)
I20260811 07:37:46.237329 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 18652
I20260811 07:37:46.270939 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 18039
2026-08-11T07:37:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (3440 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T07:37:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:46Z Disabled control of system clock
I20260811 07:37:46.323634 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38079
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:43287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:38079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:37:46.495013 18952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:46.495553 18952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:46.495679 18952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:46.501302 18952 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:46.501492 18952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:46.501529 18952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:46.501608 18952 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:46.501652 18952 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:46.508529 18952 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:43287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:38079
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:38079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:46.511039 18952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:46.513718 18952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:46.527128 18961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:46.527216 18958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:46.527128 18959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:46.527742 18952 server_base.cc:1034] running on GCE node
I20260811 07:37:46.528574 18952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:46.530022 18952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:46.531282 18952 hybrid_clock.cc:648] HybridClock initialized: now 1786433866531263 us; error 53 us; skew 500 ppm
I20260811 07:37:46.534062 18952 webserver.cc:460] Webserver started at http://127.22.4.254:34009/ using document root <none> and password file <none>
I20260811 07:37:46.535017 18952 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:46.535192 18952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:46.535485 18952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:46.538129 18952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "fff94c3cfbaf4641bbdd70b5026511ed"
format_stamp: "Formatted at 2026-08-11 07:37:46 on dist-test-slave-7z32"
server_key: "3903da2bb46cf547f18da6ad7c95d1d8"
server_key_iv: "2443f52598aa296a51c31a3e7f3e009d"
server_key_version: "encryptionkey@0"
I20260811 07:37:46.538956 18952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "fff94c3cfbaf4641bbdd70b5026511ed"
format_stamp: "Formatted at 2026-08-11 07:37:46 on dist-test-slave-7z32"
server_key: "3903da2bb46cf547f18da6ad7c95d1d8"
server_key_iv: "2443f52598aa296a51c31a3e7f3e009d"
server_key_version: "encryptionkey@0"
I20260811 07:37:46.544732 18952 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:37:46.548745 18967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:46.551214 18952 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:37:46.551520 18952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "fff94c3cfbaf4641bbdd70b5026511ed"
format_stamp: "Formatted at 2026-08-11 07:37:46 on dist-test-slave-7z32"
server_key: "3903da2bb46cf547f18da6ad7c95d1d8"
server_key_iv: "2443f52598aa296a51c31a3e7f3e009d"
server_key_version: "encryptionkey@0"
I20260811 07:37:46.551703 18952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:46.568002 18952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:46.569159 18952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:46.569469 18952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:46.580252 18952 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:38079
I20260811 07:37:46.580295 19063 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:38079 every 8 connection(s)
I20260811 07:37:46.581905 18952 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:46.587173 19065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:46.587530 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 18952
I20260811 07:37:46.587703 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:46.588136 22547 external_mini_cluster.cc:1428] Setting key 1329f0019e46df6ddba78c8756bffbf2
I20260811 07:37:46.599704 19065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed: Bootstrap starting.
I20260811 07:37:46.603163 19070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.590251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37834 (local address 127.22.4.254:38079)
0811 07:37:46.591683 (+ 1432us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:46.591716 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:46.591779 (+ 63us) server_negotiation.cc:407] Connection header received
0811 07:37:46.592777 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:46.592807 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:46.593510 (+ 703us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:46.594014 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:46.594601 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.596461 (+ 1860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.597864 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.598718 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.599068 (+ 350us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:46.600313 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:46.600322 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:46.600344 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:46.600990 (+ 646us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:46.601096 (+ 106us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:46.601132 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:46.601274 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:46.601542 (+ 268us) server_negotiation.cc:299] Negotiation successful
0811 07:37:46.601925 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":293,"threads_started":1}
I20260811 07:37:46.603399 19065 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:46.604405 19065 log.cc:824] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:46.607573 19065 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed: No bootstrap required, opened a new log
I20260811 07:37:46.613330 19065 raft_consensus.cc:348] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff94c3cfbaf4641bbdd70b5026511ed" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38079 } }
I20260811 07:37:46.613763 19065 raft_consensus.cc:374] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:46.613816 19065 raft_consensus.cc:729] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fff94c3cfbaf4641bbdd70b5026511ed, State: Initialized, Role: FOLLOWER
I20260811 07:37:46.614391 19065 consensus_queue.cc:260] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff94c3cfbaf4641bbdd70b5026511ed" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38079 } }
I20260811 07:37:46.614553 19065 raft_consensus.cc:388] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:46.614652 19065 raft_consensus.cc:482] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:46.614774 19065 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:46.616178 19065 raft_consensus.cc:504] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff94c3cfbaf4641bbdd70b5026511ed" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38079 } }
I20260811 07:37:46.616726 19065 leader_election.cc:302] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fff94c3cfbaf4641bbdd70b5026511ed; no voters:
I20260811 07:37:46.617190 19065 leader_election.cc:288] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:46.617442 19073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:46.617947 19073 raft_consensus.cc:686] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [term 1 LEADER]: Becoming Leader. State: Replica: fff94c3cfbaf4641bbdd70b5026511ed, State: Running, Role: LEADER
I20260811 07:37:46.618485 19073 consensus_queue.cc:237] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff94c3cfbaf4641bbdd70b5026511ed" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38079 } }
I20260811 07:37:46.619565 19065 sys_catalog.cc:564] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:46.621152 19075 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fff94c3cfbaf4641bbdd70b5026511ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff94c3cfbaf4641bbdd70b5026511ed" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38079 } } }
I20260811 07:37:46.621373 19075 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:46.621951 19076 sys_catalog.cc:455] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader fff94c3cfbaf4641bbdd70b5026511ed. Latest consensus state: current_term: 1 leader_uuid: "fff94c3cfbaf4641bbdd70b5026511ed" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fff94c3cfbaf4641bbdd70b5026511ed" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 38079 } } }
I20260811 07:37:46.622175 19076 sys_catalog.cc:458] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed [sys.catalog]: This master's current role is: LEADER
W20260811 07:37:46.626922 19097 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:37:46.627094 19097 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:37:46.627184 19087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:46.628212 19087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:46.637622 19087 catalog_manager.cc:1347] Generated new cluster ID: d6ac9e208d934f9792fbcd8290544281
I20260811 07:37:46.637756 19087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:46.656672 19087 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:46.657964 19087 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:46.668977 19087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed: Generated new TSK 0
I20260811 07:37:46.670037 19087 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:37:46.682934 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38079
--builtin_ntp_servers=127.22.4.212:43287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:37:46.855495 19104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:46.856405 19104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:46.856864 19104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:46.862138 19104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:46.862272 19104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:46.862390 19104 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:37:46.869849 19104 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:43287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:46.871417 19104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:46.873272 19104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:46.887189 19114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:46.887163 19116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:46.887163 19120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:46.887667 19104 server_base.cc:1034] running on GCE node
I20260811 07:37:46.888429 19104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:46.889402 19104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:46.890609 19104 hybrid_clock.cc:648] HybridClock initialized: now 1786433866890552 us; error 79 us; skew 500 ppm
I20260811 07:37:46.893481 19104 webserver.cc:460] Webserver started at http://127.22.4.193:45397/ using document root <none> and password file <none>
I20260811 07:37:46.894557 19104 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:46.894696 19104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:46.895071 19104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:46.898427 19104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "5e175223f7974751b789472d05500e7d"
format_stamp: "Formatted at 2026-08-11 07:37:46 on dist-test-slave-7z32"
server_key: "dd235c3bca41de53b2e516492c2269d7"
server_key_iv: "00af233f2a60838eb126e0d8007633f0"
server_key_version: "encryptionkey@0"
I20260811 07:37:46.899360 19104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "5e175223f7974751b789472d05500e7d"
format_stamp: "Formatted at 2026-08-11 07:37:46 on dist-test-slave-7z32"
server_key: "dd235c3bca41de53b2e516492c2269d7"
server_key_iv: "00af233f2a60838eb126e0d8007633f0"
server_key_version: "encryptionkey@0"
I20260811 07:37:46.905470 19104 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:37:46.910308 19130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:46.912833 19104 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:37:46.913118 19104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "5e175223f7974751b789472d05500e7d"
format_stamp: "Formatted at 2026-08-11 07:37:46 on dist-test-slave-7z32"
server_key: "dd235c3bca41de53b2e516492c2269d7"
server_key_iv: "00af233f2a60838eb126e0d8007633f0"
server_key_version: "encryptionkey@0"
I20260811 07:37:46.913345 19104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:46.932585 19104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:46.933704 19104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:46.933966 19104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:46.935202 19104 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:46.936772 19104 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:46.936864 19104 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:46.936946 19104 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:46.936995 19104 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:46.956748 19104 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:46051
I20260811 07:37:46.956916 19321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:46051 every 8 connection(s)
I20260811 07:37:46.958287 19104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:37:46.959093 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 19104
I20260811 07:37:46.959288 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:37:46.959672 22547 external_mini_cluster.cc:1428] Setting key f7097611e06bf47998cf3c63060843fd
I20260811 07:37:46.963604 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38079
--builtin_ntp_servers=127.22.4.212:43287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:37:46.981962 19070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.961459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:59145 (local address 127.22.4.254:38079)
0811 07:37:46.961635 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:46.961640 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:46.965235 (+ 3595us) server_negotiation.cc:407] Connection header received
0811 07:37:46.970675 (+ 5440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:46.970679 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:46.970782 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:46.971037 (+ 255us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:46.973980 (+ 2943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.974593 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.978146 (+ 3553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.978506 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.978933 (+ 427us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:46.981167 (+ 2234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:46.981172 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:46.981174 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:46.981196 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:46.981226 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:46.981237 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:46.981334 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:46.981700 (+ 366us) server_negotiation.cc:299] Negotiation successful
0811 07:37:46.981808 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:37:46.984321 19326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:46.962546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38079 (local address 127.22.4.193:59145)
0811 07:37:46.964913 (+ 2367us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:46.965005 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:46.970091 (+ 5086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:46.971582 (+ 1491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:46.971601 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:46.971793 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:46.973429 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:46.973480 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.974949 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.974957 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:46.977767 (+ 2810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:46.977808 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:46.979026 (+ 1218us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:46.979035 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:46.979423 (+ 388us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:46.980493 (+ 1070us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:46.980497 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:46.980598 (+ 101us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:46.980813 (+ 215us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:46.981376 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:46.981392 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:46.981404 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 07:37:46.981628 (+ 224us) client_negotiation.cc:240] Negotiation successful
0811 07:37:46.982422 (+ 794us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1397,"thread_start_us":520,"threads_started":1}
I20260811 07:37:46.986675 19322 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38079
I20260811 07:37:46.987156 19322 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:46.988209 19322 heartbeater.cc:511] Master 127.22.4.254:38079 requested a full tablet report, sending...
I20260811 07:37:46.991051 19000 ts_manager.cc:194] Registered new tserver with Master: 5e175223f7974751b789472d05500e7d (127.22.4.193:46051)
I20260811 07:37:46.992480 19000 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.193:59145
W20260811 07:37:47.147799 19327 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:47.148263 19327 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:47.148317 19327 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:47.153992 19327 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:47.154166 19327 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:47.154245 19327 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:37:47.161464 19327 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:43287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19327
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:47.163767 19327 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:47.166555 19327 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:47.183887 19333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:47.183882 19332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:47.183897 19338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:47.184365 19327 server_base.cc:1034] running on GCE node
I20260811 07:37:47.185225 19327 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:47.186288 19327 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:47.189800 19327 hybrid_clock.cc:648] HybridClock initialized: now 1786433867189745 us; error 77 us; skew 500 ppm
I20260811 07:37:47.193715 19327 webserver.cc:460] Webserver started at http://127.22.4.194:35511/ using document root <none> and password file <none>
I20260811 07:37:47.195129 19327 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:47.195304 19327 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:47.195660 19327 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:47.200153 19327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "ac2cdbfd827541b193229c8d73ec9234"
format_stamp: "Formatted at 2026-08-11 07:37:47 on dist-test-slave-7z32"
server_key: "aba911471744aa2f0dd8e07e1950a6ee"
server_key_iv: "c439c91b376a271aa265894a2581a81d"
server_key_version: "encryptionkey@0"
I20260811 07:37:47.201125 19327 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "ac2cdbfd827541b193229c8d73ec9234"
format_stamp: "Formatted at 2026-08-11 07:37:47 on dist-test-slave-7z32"
server_key: "aba911471744aa2f0dd8e07e1950a6ee"
server_key_iv: "c439c91b376a271aa265894a2581a81d"
server_key_version: "encryptionkey@0"
I20260811 07:37:47.208539 19327 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260811 07:37:47.213328 19351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:47.215772 19327 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 07:37:47.216049 19327 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "ac2cdbfd827541b193229c8d73ec9234"
format_stamp: "Formatted at 2026-08-11 07:37:47 on dist-test-slave-7z32"
server_key: "aba911471744aa2f0dd8e07e1950a6ee"
server_key_iv: "c439c91b376a271aa265894a2581a81d"
server_key_version: "encryptionkey@0"
I20260811 07:37:47.216264 19327 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:47.237592 19327 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:47.238973 19327 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:47.239287 19327 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:47.240234 19327 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:47.241797 19327 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:47.241881 19327 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:47.241976 19327 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:47.242019 19327 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:47.258023 19327 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:33861
I20260811 07:37:47.258049 19538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:33861 every 8 connection(s)
I20260811 07:37:47.259487 19327 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:37:47.261318 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 19327
I20260811 07:37:47.261456 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:37:47.261992 22547 external_mini_cluster.cc:1428] Setting key 81833b6d3d6e800527f2ca54337a8cc4
I20260811 07:37:47.265650 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38079
--builtin_ntp_servers=127.22.4.212:43287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:37:47.274667 19070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.262526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:47113 (local address 127.22.4.254:38079)
0811 07:37:47.263066 (+ 540us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.263070 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.265035 (+ 1965us) server_negotiation.cc:407] Connection header received
0811 07:37:47.267238 (+ 2203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.267243 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.267336 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.267461 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:47.268834 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.269589 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.271421 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.271941 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.272129 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.273771 (+ 1642us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:47.273778 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:47.273785 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:47.273813 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:47.273852 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:47.273870 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:47.273989 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.274240 (+ 251us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.274359 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417}
I20260811 07:37:47.275656 19543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.263383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38079 (local address 127.22.4.194:47113)
0811 07:37:47.264810 (+ 1427us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.264888 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.266913 (+ 2025us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.267739 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.267749 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.267887 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:47.268633 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.268651 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.269856 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.269862 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.271189 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.271214 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.272202 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.272206 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.272582 (+ 376us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.273368 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:47.273370 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:47.273424 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:47.273531 (+ 107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:47.274027 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:47.274037 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:47.274043 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.274192 (+ 149us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.274521 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":242,"threads_started":1}
I20260811 07:37:47.277488 19539 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38079
I20260811 07:37:47.277832 19539 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:47.278751 19539 heartbeater.cc:511] Master 127.22.4.254:38079 requested a full tablet report, sending...
I20260811 07:37:47.280741 19000 ts_manager.cc:194] Registered new tserver with Master: ac2cdbfd827541b193229c8d73ec9234 (127.22.4.194:33861)
I20260811 07:37:47.281746 19000 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.194:47113
W20260811 07:37:47.438717 19544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:47.439276 19544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:47.439337 19544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:47.447324 19544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:47.447479 19544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:47.447640 19544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:37:47.456736 19544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:43287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:38079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:47.458631 19544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:47.462359 19544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:47.478590 19551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:47.478992 19544 server_base.cc:1034] running on GCE node
W20260811 07:37:47.478675 19549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:47.479231 19553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:47.480099 19544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:47.481297 19544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:47.482569 19544 hybrid_clock.cc:648] HybridClock initialized: now 1786433867482537 us; error 52 us; skew 500 ppm
I20260811 07:37:47.486240 19544 webserver.cc:460] Webserver started at http://127.22.4.195:34179/ using document root <none> and password file <none>
I20260811 07:37:47.487332 19544 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:47.487464 19544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:47.487807 19544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:47.491304 19544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "d24e52e6b80a43fda2d5aa1ef682f37f"
format_stamp: "Formatted at 2026-08-11 07:37:47 on dist-test-slave-7z32"
server_key: "bcf35598c57317373be81153c6695e4c"
server_key_iv: "8391b93f40e9ae7cce83ad5c68d834b7"
server_key_version: "encryptionkey@0"
I20260811 07:37:47.492251 19544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "d24e52e6b80a43fda2d5aa1ef682f37f"
format_stamp: "Formatted at 2026-08-11 07:37:47 on dist-test-slave-7z32"
server_key: "bcf35598c57317373be81153c6695e4c"
server_key_iv: "8391b93f40e9ae7cce83ad5c68d834b7"
server_key_version: "encryptionkey@0"
I20260811 07:37:47.499142 19544 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:37:47.504159 19565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:47.506723 19544 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:37:47.507118 19544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "d24e52e6b80a43fda2d5aa1ef682f37f"
format_stamp: "Formatted at 2026-08-11 07:37:47 on dist-test-slave-7z32"
server_key: "bcf35598c57317373be81153c6695e4c"
server_key_iv: "8391b93f40e9ae7cce83ad5c68d834b7"
server_key_version: "encryptionkey@0"
I20260811 07:37:47.507368 19544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:47.533056 19544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:47.534407 19544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:47.534706 19544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:47.535789 19544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:47.537652 19544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:47.537784 19544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:47.537912 19544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:47.537959 19544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:47.553313 19544 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:34119
I20260811 07:37:47.553354 19734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:34119 every 8 connection(s)
I20260811 07:37:47.554948 19544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:37:47.560014 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 19544
I20260811 07:37:47.560339 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:37:47.560989 22547 external_mini_cluster.cc:1428] Setting key 96d97fb2ef593d1d11c23b79ec437466
I20260811 07:37:47.570708 19070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.558360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:47905 (local address 127.22.4.254:38079)
0811 07:37:47.558554 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.558559 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.560401 (+ 1842us) server_negotiation.cc:407] Connection header received
0811 07:37:47.563014 (+ 2613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.563018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.563106 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.563195 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:47.564989 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.565619 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.567572 (+ 1953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.567833 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.567975 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.569990 (+ 2015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:47.569994 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:47.569996 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:47.570018 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:47.570048 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:47.570058 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:47.570163 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.570377 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.570489 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:37:47.572556 19740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.558746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:38079 (local address 127.22.4.195:47905)
0811 07:37:47.560071 (+ 1325us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.560189 (+ 118us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.562633 (+ 2444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.563480 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.563493 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.563639 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:47.564733 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.564762 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.565803 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.565806 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.567334 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.567357 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.568062 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.568067 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.568330 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.569474 (+ 1144us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:47.569480 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:47.569555 (+ 75us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:47.569698 (+ 143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:47.570161 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:47.570178 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:47.570189 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.570378 (+ 189us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.570954 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":229,"threads_started":1}
I20260811 07:37:47.574702 19737 heartbeater.cc:347] Connected to a master server at 127.22.4.254:38079
I20260811 07:37:47.575325 19737 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:47.576157 19737 heartbeater.cc:511] Master 127.22.4.254:38079 requested a full tablet report, sending...
I20260811 07:37:47.578198 19000 ts_manager.cc:194] Registered new tserver with Master: d24e52e6b80a43fda2d5aa1ef682f37f (127.22.4.195:34119)
I20260811 07:37:47.578975 19000 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.195:47905
I20260811 07:37:47.592720 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:37:47.603833 19070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.596711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37844 (local address 127.22.4.254:38079)
0811 07:37:47.596972 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.596980 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.597109 (+ 129us) server_negotiation.cc:407] Connection header received
0811 07:37:47.597287 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.597291 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.597368 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.597519 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:47.598049 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.598923 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.600454 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.600766 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.600938 (+ 172us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.602502 (+ 1564us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:47.602506 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:47.602508 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:47.602529 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:47.602562 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:47.602571 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:47.602721 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.603616 (+ 895us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.603678 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:37:47.609984 19000 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37844:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:37:47.613844 19000 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:37:47.638128 19758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.631147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50140 (local address 127.22.4.194:33861)
0811 07:37:47.632146 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.632166 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.632207 (+ 41us) server_negotiation.cc:407] Connection header received
0811 07:37:47.632322 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.632331 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.632624 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.632863 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:47.633497 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.634807 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.636578 (+ 1771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.637252 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.637394 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.637687 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.637785 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.637927 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":830,"thread_start_us":218,"threads_started":1}
I20260811 07:37:47.638124 19755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.630956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:33861 (local address 127.0.0.1:50140)
0811 07:37:47.631593 (+ 637us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.631679 (+ 86us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.631891 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.633125 (+ 1234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.633134 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.633165 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:47.633364 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.633372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.635010 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.635014 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.636427 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.636439 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.637403 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.637407 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.637525 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.637569 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.637700 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.637891 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":73,"thread_start_us":176,"threads_started":1}
I20260811 07:37:47.639737 19759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.632045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:34119 (local address 127.0.0.1:42872)
0811 07:37:47.632451 (+ 406us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.632468 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.632577 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.633633 (+ 1056us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.633636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.633656 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:47.633771 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.633778 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.635917 (+ 2139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.635921 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.637399 (+ 1478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.637416 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.639219 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.639223 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.639322 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.639353 (+ 31us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.639435 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.639545 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":175,"thread_start_us":144,"threads_started":1}
I20260811 07:37:47.640190 19760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.632288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:46051 (local address 127.0.0.1:34180)
0811 07:37:47.632930 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.632973 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.633072 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.634205 (+ 1133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.634209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.634232 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:47.634411 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.634421 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.635809 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.635814 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.637399 (+ 1585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.637416 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.639748 (+ 2332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.639755 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.639863 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.639891 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.639979 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.640064 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":73,"thread_start_us":153,"threads_started":1}
I20260811 07:37:47.640383 19763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.632921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34180 (local address 127.22.4.193:46051)
0811 07:37:47.633475 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.633486 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.633526 (+ 40us) server_negotiation.cc:407] Connection header received
0811 07:37:47.633638 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.633643 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.634011 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.634241 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:47.634587 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.635675 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.637603 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.639573 (+ 1970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.639726 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.639957 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.640023 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.640169 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":140,"threads_started":1}
I20260811 07:37:47.640478 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.632382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42872 (local address 127.22.4.195:34119)
0811 07:37:47.632853 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.632869 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.632901 (+ 32us) server_negotiation.cc:407] Connection header received
0811 07:37:47.633025 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.633032 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.633310 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.633799 (+ 489us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:47.634493 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.635779 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.637637 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.638666 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.638856 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.639130 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.640127 (+ 997us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.640272 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":103,"threads_started":1}
I20260811 07:37:47.643838 19634 tablet_service.cc:1467] Processing CreateTablet for tablet 5db39d6e693f469f912d706ce504e196 (DEFAULT_TABLE table=test-table [id=eb3f4c84c6334b7c8e16fa23428260aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:47.643826 19428 tablet_service.cc:1467] Processing CreateTablet for tablet 5db39d6e693f469f912d706ce504e196 (DEFAULT_TABLE table=test-table [id=eb3f4c84c6334b7c8e16fa23428260aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:47.644264 19213 tablet_service.cc:1467] Processing CreateTablet for tablet 5db39d6e693f469f912d706ce504e196 (DEFAULT_TABLE table=test-table [id=eb3f4c84c6334b7c8e16fa23428260aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:47.645463 19634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db39d6e693f469f912d706ce504e196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:47.645463 19428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db39d6e693f469f912d706ce504e196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:47.645803 19213 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db39d6e693f469f912d706ce504e196. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:47.656878 19766 tablet_bootstrap.cc:492] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Bootstrap starting.
I20260811 07:37:47.656878 19765 tablet_bootstrap.cc:492] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Bootstrap starting.
I20260811 07:37:47.657682 19764 tablet_bootstrap.cc:492] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d: Bootstrap starting.
I20260811 07:37:47.661099 19766 tablet_bootstrap.cc:654] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:47.661099 19765 tablet_bootstrap.cc:654] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:47.661314 19764 tablet_bootstrap.cc:654] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:47.662330 19764 log.cc:824] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:47.662541 19766 log.cc:824] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:47.662535 19765 log.cc:824] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:47.666476 19766 tablet_bootstrap.cc:492] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: No bootstrap required, opened a new log
I20260811 07:37:47.666581 19764 tablet_bootstrap.cc:492] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d: No bootstrap required, opened a new log
I20260811 07:37:47.666957 19766 ts_tablet_manager.cc:1397] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260811 07:37:47.667246 19765 tablet_bootstrap.cc:492] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: No bootstrap required, opened a new log
I20260811 07:37:47.667238 19764 ts_tablet_manager.cc:1397] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260811 07:37:47.667611 19765 ts_tablet_manager.cc:1397] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Time spent bootstrapping tablet: real 0.011s user 0.009s sys 0.000s
I20260811 07:37:47.673127 19766 raft_consensus.cc:348] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.673127 19765 raft_consensus.cc:348] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.673578 19765 raft_consensus.cc:374] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:47.673578 19766 raft_consensus.cc:374] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:47.673650 19766 raft_consensus.cc:729] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d24e52e6b80a43fda2d5aa1ef682f37f, State: Initialized, Role: FOLLOWER
I20260811 07:37:47.673650 19765 raft_consensus.cc:729] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac2cdbfd827541b193229c8d73ec9234, State: Initialized, Role: FOLLOWER
I20260811 07:37:47.673491 19764 raft_consensus.cc:348] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.674329 19764 raft_consensus.cc:374] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:47.674284 19765 consensus_queue.cc:260] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.674284 19766 consensus_queue.cc:260] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.674417 19764 raft_consensus.cc:729] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e175223f7974751b789472d05500e7d, State: Initialized, Role: FOLLOWER
I20260811 07:37:47.675175 19764 consensus_queue.cc:260] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.675768 19766 ts_tablet_manager.cc:1428] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260811 07:37:47.675768 19765 ts_tablet_manager.cc:1428] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260811 07:37:47.676273 19737 heartbeater.cc:503] Master 127.22.4.254:38079 was elected leader, sending a full tablet report...
I20260811 07:37:47.676815 19764 ts_tablet_manager.cc:1428] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d: Time spent starting tablet: real 0.009s user 0.006s sys 0.004s
I20260811 07:37:47.677053 19539 heartbeater.cc:503] Master 127.22.4.254:38079 was elected leader, sending a full tablet report...
I20260811 07:37:47.677258 19322 heartbeater.cc:503] Master 127.22.4.254:38079 was elected leader, sending a full tablet report...
W20260811 07:37:47.710871 19325 tablet.cc:2369] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:37:47.761392 19541 tablet.cc:2369] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:37:47.806434 19739 tablet.cc:2369] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:47.928858 19773 raft_consensus.cc:482] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:47.929251 19773 raft_consensus.cc:504] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.931152 19773 leader_election.cc:288] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d24e52e6b80a43fda2d5aa1ef682f37f (127.22.4.195:34119), 5e175223f7974751b789472d05500e7d (127.22.4.193:46051)
I20260811 07:37:47.937071 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.931647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:33561 (local address 127.22.4.195:34119)
0811 07:37:47.931832 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.931841 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.932231 (+ 390us) server_negotiation.cc:407] Connection header received
0811 07:37:47.932463 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.932468 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.932526 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.932597 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:47.933073 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.933677 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.935338 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.935829 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.936015 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.936086 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.936731 (+ 645us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.936849 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 07:37:47.937198 19763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.931899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:51359 (local address 127.22.4.193:46051)
0811 07:37:47.932070 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.932077 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.932297 (+ 220us) server_negotiation.cc:407] Connection header received
0811 07:37:47.932522 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.932525 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.932601 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.932711 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:47.933168 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.933750 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.935402 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.935871 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.936044 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.936123 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.936906 (+ 783us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.937016 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 07:37:47.937434 19781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.931479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:34119 (local address 127.22.4.194:33561)
0811 07:37:47.932073 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.932095 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.932297 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.932649 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.932655 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.932684 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:47.932935 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.932944 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.933817 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.933821 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.935169 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.935185 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.935993 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.935997 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.936494 (+ 497us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.936579 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.936668 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.936780 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":494,"mutex_wait_us":111,"thread_start_us":210,"threads_started":1}
I20260811 07:37:47.937809 19780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.931703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:46051 (local address 127.22.4.194:51359)
0811 07:37:47.932141 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.932155 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.932335 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.932759 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.932761 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.932782 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:47.932996 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.933024 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.933963 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.933967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.935197 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.935212 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.936092 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.936097 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.936703 (+ 606us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.936749 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.936844 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.936954 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"mutex_wait_us":443,"thread_start_us":108,"threads_started":1}
I20260811 07:37:47.938405 19777 raft_consensus.cc:482] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:47.938596 19669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db39d6e693f469f912d706ce504e196" candidate_uuid: "ac2cdbfd827541b193229c8d73ec9234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" is_pre_election: true
I20260811 07:37:47.938668 19777 raft_consensus.cc:504] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.938947 19249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db39d6e693f469f912d706ce504e196" candidate_uuid: "ac2cdbfd827541b193229c8d73ec9234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e175223f7974751b789472d05500e7d" is_pre_election: true
I20260811 07:37:47.939059 19669 raft_consensus.cc:2454] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac2cdbfd827541b193229c8d73ec9234 in term 0.
I20260811 07:37:47.939337 19249 raft_consensus.cc:2454] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac2cdbfd827541b193229c8d73ec9234 in term 0.
I20260811 07:37:47.939843 19353 leader_election.cc:302] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac2cdbfd827541b193229c8d73ec9234, d24e52e6b80a43fda2d5aa1ef682f37f; no voters:
I20260811 07:37:47.940493 19777 leader_election.cc:288] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac2cdbfd827541b193229c8d73ec9234 (127.22.4.194:33861), d24e52e6b80a43fda2d5aa1ef682f37f (127.22.4.195:34119)
I20260811 07:37:47.940546 19773 raft_consensus.cc:2781] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:37:47.940645 19773 raft_consensus.cc:482] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:37:47.940719 19773 raft_consensus.cc:3037] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:47.942922 19773 raft_consensus.cc:504] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.943569 19773 leader_election.cc:288] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [CANDIDATE]: Term 1 election: Requested vote from peers d24e52e6b80a43fda2d5aa1ef682f37f (127.22.4.195:34119), 5e175223f7974751b789472d05500e7d (127.22.4.193:46051)
I20260811 07:37:47.944020 19669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db39d6e693f469f912d706ce504e196" candidate_uuid: "ac2cdbfd827541b193229c8d73ec9234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f"
I20260811 07:37:47.944188 19669 raft_consensus.cc:3037] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:47.944234 19249 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db39d6e693f469f912d706ce504e196" candidate_uuid: "ac2cdbfd827541b193229c8d73ec9234" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e175223f7974751b789472d05500e7d"
I20260811 07:37:47.944433 19249 raft_consensus.cc:3037] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:47.945818 19249 raft_consensus.cc:2454] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac2cdbfd827541b193229c8d73ec9234 in term 1.
I20260811 07:37:47.945974 19669 raft_consensus.cc:2454] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac2cdbfd827541b193229c8d73ec9234 in term 1.
I20260811 07:37:47.946390 19356 leader_election.cc:302] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e175223f7974751b789472d05500e7d, ac2cdbfd827541b193229c8d73ec9234; no voters:
I20260811 07:37:47.946954 19773 raft_consensus.cc:2781] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:47.947335 19773 raft_consensus.cc:686] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 1 LEADER]: Becoming Leader. State: Replica: ac2cdbfd827541b193229c8d73ec9234, State: Running, Role: LEADER
I20260811 07:37:47.947506 19783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.941460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:34119 (local address 127.22.4.193:47115)
0811 07:37:47.941920 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.941933 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.942141 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.942645 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.942651 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.942679 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:47.942898 (+ 219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.942908 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.944313 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.944317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.945752 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.945771 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.946734 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.946738 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.946967 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.947008 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.947154 (+ 146us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.947264 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":74,"thread_start_us":128,"threads_started":1}
I20260811 07:37:47.947937 19773 consensus_queue.cc:237] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } }
I20260811 07:37:47.948233 19761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.941671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:47115 (local address 127.22.4.195:34119)
0811 07:37:47.941808 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.941813 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.942029 (+ 216us) server_negotiation.cc:407] Connection header received
0811 07:37:47.942302 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.942309 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.942376 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.942477 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:47.943134 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.944151 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.945976 (+ 1825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.946575 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.946733 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.946793 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.947209 (+ 416us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.947339 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 07:37:47.948834 19669 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db39d6e693f469f912d706ce504e196" candidate_uuid: "5e175223f7974751b789472d05500e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" is_pre_election: true
I20260811 07:37:47.949172 19669 raft_consensus.cc:2379] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5e175223f7974751b789472d05500e7d in current term 1: Already voted for candidate ac2cdbfd827541b193229c8d73ec9234 in this term.
I20260811 07:37:47.949604 19784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.940850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:33861 (local address 127.22.4.193:40303)
0811 07:37:47.941855 (+ 1005us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:47.941876 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:47.942054 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:47.942348 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:47.942351 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:47.942368 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:47.942537 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.942544 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.946382 (+ 3838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.946386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.947740 (+ 1354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:47.947753 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.949004 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.949010 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:47.949142 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.949170 (+ 28us) client_negotiation.cc:769] Sending connection context
0811 07:37:47.949284 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 07:37:47.949395 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":895,"mutex_wait_us":43,"thread_start_us":281,"threads_started":1}
I20260811 07:37:47.949615 19758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:47.940966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:40303 (local address 127.22.4.194:33861)
0811 07:37:47.941256 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:47.941262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:47.942016 (+ 754us) server_negotiation.cc:407] Connection header received
0811 07:37:47.942191 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:47.942196 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:47.942256 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:47.942336 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:47.942659 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.943567 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.947898 (+ 4331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:47.948515 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:47.948680 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:47.948742 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:47.949353 (+ 611us) server_negotiation.cc:299] Negotiation successful
0811 07:37:47.949482 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180}
I20260811 07:37:47.950578 19457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db39d6e693f469f912d706ce504e196" candidate_uuid: "5e175223f7974751b789472d05500e7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac2cdbfd827541b193229c8d73ec9234" is_pre_election: true
I20260811 07:37:47.951768 19138 leader_election.cc:302] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5e175223f7974751b789472d05500e7d; no voters: ac2cdbfd827541b193229c8d73ec9234, d24e52e6b80a43fda2d5aa1ef682f37f
I20260811 07:37:47.952454 19777 raft_consensus.cc:2726] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 07:37:47.953552 19000 catalog_manager.cc:5495] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 reported cstate change: term changed from 0 to 1, leader changed from <none> to ac2cdbfd827541b193229c8d73ec9234 (127.22.4.194). New cstate: current_term: 1 leader_uuid: "ac2cdbfd827541b193229c8d73ec9234" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac2cdbfd827541b193229c8d73ec9234" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 } health_report { overall_health: UNKNOWN } } }
I20260811 07:37:48.026321 19758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:48.020342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50154 (local address 127.22.4.194:33861)
0811 07:37:48.020626 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:48.020632 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:48.020695 (+ 63us) server_negotiation.cc:407] Connection header received
0811 07:37:48.020892 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:48.020897 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:48.020990 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:48.021108 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:37:48.021554 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:48.022259 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:48.023586 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:48.024052 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:48.024199 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:48.024669 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:37:48.025345 (+ 676us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:37:48.025503 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:48.025998 (+ 495us) server_negotiation.cc:299] Negotiation successful
0811 07:37:48.026064 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260811 07:37:48.036857 19669 raft_consensus.cc:1261] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 1 FOLLOWER]: Refusing update from remote peer ac2cdbfd827541b193229c8d73ec9234: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:48.036859 19249 raft_consensus.cc:1261] T 5db39d6e693f469f912d706ce504e196 P 5e175223f7974751b789472d05500e7d [term 1 FOLLOWER]: Refusing update from remote peer ac2cdbfd827541b193229c8d73ec9234: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:48.038184 19773 consensus_queue.cc:1035] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e175223f7974751b789472d05500e7d" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 46051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:48.038916 19787 consensus_queue.cc:1035] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d24e52e6b80a43fda2d5aa1ef682f37f" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 34119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:48.054112 19795 mvcc.cc:205] Tried to move back new op lower bound from 7317233123466502144 to 7317233123120828416. Current Snapshot: MvccSnapshot[applied={T|T < 7317233123466502144}]
I20260811 07:37:48.068094 18994 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:48.068408 18994 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37844:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:48.073597 18994 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fff94c3cfbaf4641bbdd70b5026511ed: Sending DeleteTablet for 3 replicas of tablet 5db39d6e693f469f912d706ce504e196
I20260811 07:37:48.075939 19634 tablet_service.cc:1514] Processing DeleteTablet for tablet 5db39d6e693f469f912d706ce504e196 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:48 UTC) from {username='slave'} at 127.0.0.1:42872
I20260811 07:37:48.075939 19213 tablet_service.cc:1514] Processing DeleteTablet for tablet 5db39d6e693f469f912d706ce504e196 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:48 UTC) from {username='slave'} at 127.0.0.1:34180
I20260811 07:37:48.076551 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 19104
I20260811 07:37:48.077883 19428 tablet_service.cc:1514] Processing DeleteTablet for tablet 5db39d6e693f469f912d706ce504e196 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:48 UTC) from {username='slave'} at 127.0.0.1:50140
I20260811 07:37:48.087265 19807 tablet_replica.cc:330] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: stopping tablet replica
I20260811 07:37:48.088148 19807 raft_consensus.cc:2229] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:48.088937 19807 raft_consensus.cc:2258] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:48.089854 19814 tablet_replica.cc:330] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: stopping tablet replica
I20260811 07:37:48.090581 19814 raft_consensus.cc:2229] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:37:48.091310 19814 raft_consensus.cc:2258] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:48.093851 19814 ts_tablet_manager.cc:1905] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:48.093851 19807 ts_tablet_manager.cc:1905] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:48.100517 19814 ts_tablet_manager.cc:1918] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:48.100517 19807 ts_tablet_manager.cc:1918] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:48.100756 19814 log.cc:1196] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/5db39d6e693f469f912d706ce504e196
I20260811 07:37:48.101102 19807 log.cc:1196] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/5db39d6e693f469f912d706ce504e196
I20260811 07:37:48.101392 19814 ts_tablet_manager.cc:1939] T 5db39d6e693f469f912d706ce504e196 P ac2cdbfd827541b193229c8d73ec9234: Deleting consensus metadata
I20260811 07:37:48.101922 19807 ts_tablet_manager.cc:1939] T 5db39d6e693f469f912d706ce504e196 P d24e52e6b80a43fda2d5aa1ef682f37f: Deleting consensus metadata
W20260811 07:37:48.102499 18979 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:46051 (error 108)
I20260811 07:37:48.103802 18972 catalog_manager.cc:4841] TS d24e52e6b80a43fda2d5aa1ef682f37f (127.22.4.195:34119): tablet 5db39d6e693f469f912d706ce504e196 (table test-table [id=eb3f4c84c6334b7c8e16fa23428260aa]) successfully deleted
I20260811 07:37:48.104102 18972 catalog_manager.cc:4841] TS ac2cdbfd827541b193229c8d73ec9234 (127.22.4.194:33861): tablet 5db39d6e693f469f912d706ce504e196 (table test-table [id=eb3f4c84c6334b7c8e16fa23428260aa]) successfully deleted
I20260811 07:37:48.104388 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 19327
I20260811 07:37:48.124477 19760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:48.123947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:46051 (local address 127.0.0.1:34190)
0811 07:37:48.124182 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:48.124331 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:46051: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260811 07:37:48.124974 18979 catalog_manager.cc:4584] TS 5e175223f7974751b789472d05500e7d (127.22.4.193:46051): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5db39d6e693f469f912d706ce504e196: Network error: Client connection negotiation failed: client connection to 127.22.4.193:46051: connect: Connection refused (error 111)
I20260811 07:37:48.133116 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 19544
I20260811 07:37:48.155529 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 18952
2026-08-11T07:37:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1889 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:37:48 dist-test-slave-7z32 krb5kdc[19819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:37:48 dist-test-slave-7z32 krb5kdc[19819](info): set up 2 sockets
Aug 11 07:37:48 dist-test-slave-7z32 krb5kdc[19819](info): commencing operation
krb5kdc: starting...
W20260811 07:37:49.585600 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.390s user 0.004s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:37:49 dist-test-slave-7z32 krb5kdc[19819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:37:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:37:49.780778 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37521
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:37521
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:49.925030 19836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:49.925395 19836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:49.925441 19836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:49.930153 19836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:49.930258 19836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:49.930280 19836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:49.930298 19836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:49.930316 19836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:49.937201 19836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:37521
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:37521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:49.938735 19836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:49.940150 19836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:49.952683 19845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:49.952683 19844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:49.952692 19847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:49.953253 19836 server_base.cc:1034] running on GCE node
I20260811 07:37:49.954274 19836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:49.956130 19836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:49.957397 19836 hybrid_clock.cc:648] HybridClock initialized: now 1786433869957353 us; error 72 us; skew 500 ppm
Aug 11 07:37:49 dist-test-slave-7z32 krb5kdc[19819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433869, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:49.967389 19836 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:37:49.969530 19836 webserver.cc:460] Webserver started at http://127.22.4.254:33173/ using document root <none> and password file <none>
I20260811 07:37:49.970474 19836 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:49.970574 19836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:49.970963 19836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:49.979084 19836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "02001939bf9a4765928e7e1ab5d91820"
format_stamp: "Formatted at 2026-08-11 07:37:49 on dist-test-slave-7z32"
server_key: "3b9d0594c4b98082cfcd761ca265c47e"
server_key_iv: "6beed66920502002df20866f0957be54"
server_key_version: "encryptionkey@0"
I20260811 07:37:49.980476 19836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "02001939bf9a4765928e7e1ab5d91820"
format_stamp: "Formatted at 2026-08-11 07:37:49 on dist-test-slave-7z32"
server_key: "3b9d0594c4b98082cfcd761ca265c47e"
server_key_iv: "6beed66920502002df20866f0957be54"
server_key_version: "encryptionkey@0"
I20260811 07:37:49.989871 19836 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.004s sys 0.005s
I20260811 07:37:49.995754 19865 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:49.998538 19836 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.002s
I20260811 07:37:49.998805 19836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "02001939bf9a4765928e7e1ab5d91820"
format_stamp: "Formatted at 2026-08-11 07:37:49 on dist-test-slave-7z32"
server_key: "3b9d0594c4b98082cfcd761ca265c47e"
server_key_iv: "6beed66920502002df20866f0957be54"
server_key_version: "encryptionkey@0"
I20260811 07:37:49.999159 19836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:50.028355 19836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:50.034228 19836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:50.034540 19836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:50.047747 19836 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:37521
I20260811 07:37:50.047807 19953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:37521 every 8 connection(s)
I20260811 07:37:50.049300 19836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:50.053232 19955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:50.055320 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 19836
I20260811 07:37:50.055488 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:50.056227 22547 external_mini_cluster.cc:1428] Setting key 11b72fbeee93aaa8e5e75c36884fee54
I20260811 07:37:50.061218 19955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820: Bootstrap starting.
I20260811 07:37:50.064713 19955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:50.065918 19955 log.cc:824] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:50.069463 19955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820: No bootstrap required, opened a new log
Aug 11 07:37:50 dist-test-slave-7z32 krb5kdc[19819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433869, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:50.076375 19955 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02001939bf9a4765928e7e1ab5d91820" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37521 } }
I20260811 07:37:50.076900 19955 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:50.076975 19955 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02001939bf9a4765928e7e1ab5d91820, State: Initialized, Role: FOLLOWER
I20260811 07:37:50.078068 19955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02001939bf9a4765928e7e1ab5d91820" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37521 } }
I20260811 07:37:50.078550 19955 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:50.078791 19955 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:50.079041 19955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:50.080384 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:50.058994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42346 (local address 127.22.4.254:37521)
0811 07:37:50.059629 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:50.059651 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:50.059704 (+ 53us) server_negotiation.cc:407] Connection header received
0811 07:37:50.060680 (+ 976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:50.060707 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:50.061224 (+ 517us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:50.061698 (+ 474us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:50.062993 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.064396 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.065965 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.066746 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.067141 (+ 395us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:50.070914 (+ 3773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:50.070925 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:50.070954 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:50.071014 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:50.074998 (+ 3984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:50.075900 (+ 902us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:50.075909 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:50.075923 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:50.076259 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:50.077001 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:50.077008 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:50.077009 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:50.077875 (+ 866us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:50.078381 (+ 506us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:50.078742 (+ 361us) server_negotiation.cc:299] Negotiation successful
0811 07:37:50.079278 (+ 536us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":198,"threads_started":1}
I20260811 07:37:50.080667 19955 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02001939bf9a4765928e7e1ab5d91820" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37521 } }
I20260811 07:37:50.081394 19955 leader_election.cc:302] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02001939bf9a4765928e7e1ab5d91820; no voters:
I20260811 07:37:50.082122 19955 leader_election.cc:288] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:50.082314 19962 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:50.082659 19962 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [term 1 LEADER]: Becoming Leader. State: Replica: 02001939bf9a4765928e7e1ab5d91820, State: Running, Role: LEADER
I20260811 07:37:50.083139 19962 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02001939bf9a4765928e7e1ab5d91820" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37521 } }
I20260811 07:37:50.084767 19955 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:50.084720 19964 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02001939bf9a4765928e7e1ab5d91820. Latest consensus state: current_term: 1 leader_uuid: "02001939bf9a4765928e7e1ab5d91820" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02001939bf9a4765928e7e1ab5d91820" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37521 } } }
I20260811 07:37:50.085753 19964 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:50.086651 19963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02001939bf9a4765928e7e1ab5d91820" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02001939bf9a4765928e7e1ab5d91820" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 37521 } } }
I20260811 07:37:50.086861 19963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:50.087328 19975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:50.092149 19975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:50.102221 19975 catalog_manager.cc:1347] Generated new cluster ID: b08c64cc3d304e9b917444817208e59b
I20260811 07:37:50.102367 19975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:50.116500 19975 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:50.118043 19975 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:50.131147 19975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820: Generated new TSK 0
I20260811 07:37:50.132521 19975 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.22.4.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
Entry for principal kudu/127.22.4.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab.
I20260811 07:37:50.186472 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37521
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:50.372931 19998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:50.373466 19998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:50.373529 19998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:50.378902 19998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:50.379027 19998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:50.379139 19998 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:37:50.386240 19998 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.193.keytab
--principal=kudu/127.22.4.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:50.387977 19998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:50.389452 19998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:37:50.403421 19998 server_base.cc:1034] running on GCE node
W20260811 07:37:50.403318 20010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:50.403180 20006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:50.403180 20008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:50.404399 19998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:50.405468 19998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:50.406769 19998 hybrid_clock.cc:648] HybridClock initialized: now 1786433870406736 us; error 53 us; skew 500 ppm
Aug 11 07:37:50 dist-test-slave-7z32 krb5kdc[19819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433870, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:50.412189 19998 init.cc:377] Logged in from keytab as kudu/127.22.4.193@KRBTEST.COM (short username kudu)
I20260811 07:37:50.414112 19998 webserver.cc:460] Webserver started at http://127.22.4.193:38203/ using document root <none> and password file <none>
I20260811 07:37:50.415195 19998 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:50.415336 19998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:50.415639 19998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:50.418416 19998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "729c635ed72b497bb77915f1e7f9dd2a"
format_stamp: "Formatted at 2026-08-11 07:37:50 on dist-test-slave-7z32"
server_key: "a06823d2596aa02fe361210084e8644a"
server_key_iv: "fcaba719eea3de8fd78a033cd5b9b8f4"
server_key_version: "encryptionkey@0"
I20260811 07:37:50.419157 19998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "729c635ed72b497bb77915f1e7f9dd2a"
format_stamp: "Formatted at 2026-08-11 07:37:50 on dist-test-slave-7z32"
server_key: "a06823d2596aa02fe361210084e8644a"
server_key_iv: "fcaba719eea3de8fd78a033cd5b9b8f4"
server_key_version: "encryptionkey@0"
I20260811 07:37:50.424546 19998 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:37:50.429347 20022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:50.431618 19998 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:37:50.431838 19998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "729c635ed72b497bb77915f1e7f9dd2a"
format_stamp: "Formatted at 2026-08-11 07:37:50 on dist-test-slave-7z32"
server_key: "a06823d2596aa02fe361210084e8644a"
server_key_iv: "fcaba719eea3de8fd78a033cd5b9b8f4"
server_key_version: "encryptionkey@0"
I20260811 07:37:50.432008 19998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:50.456233 19998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:50.460990 19998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:50.461201 19998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:50.462039 19998 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:50.463191 19998 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:50.463274 19998 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:50.463339 19998 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:50.463357 19998 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:50.478107 19998 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:33057
I20260811 07:37:50.478389 20209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:33057 every 8 connection(s)
I20260811 07:37:50.479493 19998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:37:50.484313 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 19998
I20260811 07:37:50.484524 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:37:50.484956 22547 external_mini_cluster.cc:1428] Setting key 8a4209f873408a05c94b0b2aaec24e60
Aug 11 07:37:50 dist-test-slave-7z32 krb5kdc[19819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433870, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.193@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.194@KRBTEST.COM" created.
I20260811 07:37:50.507472 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:50.483892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:41343 (local address 127.22.4.254:37521)
0811 07:37:50.484108 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:50.484112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:50.487039 (+ 2927us) server_negotiation.cc:407] Connection header received
0811 07:37:50.488542 (+ 1503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:50.488550 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:50.488643 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:50.488787 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:50.490525 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.492037 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.495020 (+ 2983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.495364 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.495518 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:50.500843 (+ 5325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:50.500858 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:50.500862 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:50.500911 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:50.503490 (+ 2579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:50.504997 (+ 1507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:50.505001 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:50.505003 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:50.505177 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:50.505666 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:50.505674 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:50.505676 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:50.505960 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:50.506089 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:50.507009 (+ 920us) server_negotiation.cc:299] Negotiation successful
0811 07:37:50.507239 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
I20260811 07:37:50.508980 20215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:50.484800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37521 (local address 127.22.4.193:41343)
0811 07:37:50.486639 (+ 1839us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:50.486750 (+ 111us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:50.488234 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:50.489116 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:50.489126 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:50.489615 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:50.490228 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:50.490247 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.492516 (+ 2269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.492536 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:50.494664 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:50.494700 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.495653 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.495662 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:50.495980 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:50.497014 (+ 1034us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:50.497048 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:50.500302 (+ 3254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:50.503959 (+ 3657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:50.503972 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:50.504013 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:50.504658 (+ 645us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:50.505306 (+ 648us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:50.505309 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:50.505311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:50.505544 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:50.506106 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:50.506117 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:50.506622 (+ 505us) client_negotiation.cc:769] Sending connection context
0811 07:37:50.506942 (+ 320us) client_negotiation.cc:240] Negotiation successful
0811 07:37:50.507473 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1251,"thread_start_us":293,"threads_started":1}
I20260811 07:37:50.511708 20210 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37521
I20260811 07:37:50.512523 20210 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:50.513526 20210 heartbeater.cc:511] Master 127.22.4.254:37521 requested a full tablet report, sending...
I20260811 07:37:50.517269 19897 ts_manager.cc:194] Registered new tserver with Master: 729c635ed72b497bb77915f1e7f9dd2a (127.22.4.193:33057)
I20260811 07:37:50.519079 19897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.193@KRBTEST.COM'} at 127.22.4.193:41343
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
Entry for principal kudu/127.22.4.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab.
I20260811 07:37:50.537909 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37521
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:50.693073 20218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:50.693459 20218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:50.693511 20218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:50.698068 20218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:50.698165 20218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:50.698231 20218 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:37:50.704306 20218 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.194.keytab
--principal=kudu/127.22.4.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:50.705626 20218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:50.706983 20218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:50.721547 20232 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:50.721547 20227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:50.721561 20228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:50.721607 20218 server_base.cc:1034] running on GCE node
I20260811 07:37:50.722692 20218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:50.723845 20218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:50.725085 20218 hybrid_clock.cc:648] HybridClock initialized: now 1786433870725065 us; error 45 us; skew 500 ppm
Aug 11 07:37:50 dist-test-slave-7z32 krb5kdc[19819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433870, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:50.729846 20218 init.cc:377] Logged in from keytab as kudu/127.22.4.194@KRBTEST.COM (short username kudu)
I20260811 07:37:50.732870 20218 webserver.cc:460] Webserver started at http://127.22.4.194:33773/ using document root <none> and password file <none>
I20260811 07:37:50.733891 20218 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:50.734046 20218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:50.734366 20218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:50.738101 20218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "86732bc6f275467b989d66332d6b5870"
format_stamp: "Formatted at 2026-08-11 07:37:50 on dist-test-slave-7z32"
server_key: "2e92bb9e99a96b25b0353f726b51c3ff"
server_key_iv: "adbf1ae00d1c79d43afb62a1564edef9"
server_key_version: "encryptionkey@0"
I20260811 07:37:50.739086 20218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "86732bc6f275467b989d66332d6b5870"
format_stamp: "Formatted at 2026-08-11 07:37:50 on dist-test-slave-7z32"
server_key: "2e92bb9e99a96b25b0353f726b51c3ff"
server_key_iv: "adbf1ae00d1c79d43afb62a1564edef9"
server_key_version: "encryptionkey@0"
I20260811 07:37:50.746299 20218 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260811 07:37:50.751459 20243 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:50.753911 20218 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:37:50.754200 20218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "86732bc6f275467b989d66332d6b5870"
format_stamp: "Formatted at 2026-08-11 07:37:50 on dist-test-slave-7z32"
server_key: "2e92bb9e99a96b25b0353f726b51c3ff"
server_key_iv: "adbf1ae00d1c79d43afb62a1564edef9"
server_key_version: "encryptionkey@0"
I20260811 07:37:50.754418 20218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:50.793495 20218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:50.799940 20218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:50.800294 20218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:50.801275 20218 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:50.802728 20218 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:50.802816 20218 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:50.802958 20218 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:50.803004 20218 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:50.818317 20218 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:44641
I20260811 07:37:50.818351 20423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:44641 every 8 connection(s)
I20260811 07:37:50.819758 20218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:37:50.823167 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 20218
I20260811 07:37:50.823406 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:37:50.823876 22547 external_mini_cluster.cc:1428] Setting key 04b891b4b383410f9a1f1558417be9d5
Aug 11 07:37:50 dist-test-slave-7z32 krb5kdc[19819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433870, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.194@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.22.4.195@KRBTEST.COM; defaulting to no policy
I20260811 07:37:50.840659 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:50.822522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:41261 (local address 127.22.4.254:37521)
0811 07:37:50.822776 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:50.822780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:50.824793 (+ 2013us) server_negotiation.cc:407] Connection header received
0811 07:37:50.825979 (+ 1186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:50.825985 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:50.826057 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:50.826193 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:50.827749 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.828767 (+ 1018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.831021 (+ 2254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.831433 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.831551 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:50.834770 (+ 3219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:50.834777 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:50.834785 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:50.834879 (+ 94us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:50.836843 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:50.837841 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:50.837845 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:50.837846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:50.837949 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:50.838479 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:50.838481 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:50.838483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:50.838986 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:50.839238 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:50.840206 (+ 968us) server_negotiation.cc:299] Negotiation successful
0811 07:37:50.840423 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260811 07:37:50.842008 20426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:50.823253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37521 (local address 127.22.4.194:41261)
0811 07:37:50.824444 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:50.824537 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:50.825602 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:50.826405 (+ 803us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:50.826414 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:50.826913 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:50.827557 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:50.827572 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.828992 (+ 1420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.828996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:50.830725 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:50.830746 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:50.831781 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:50.831784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:50.831959 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:50.832672 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:50.832691 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:50.834397 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:50.837040 (+ 2643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:50.837050 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:50.837107 (+ 57us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:50.837683 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:50.838069 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:50.838073 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:50.838075 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:50.838332 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:50.839310 (+ 978us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:50.839329 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:50.839801 (+ 472us) client_negotiation.cc:769] Sending connection context
0811 07:37:50.840096 (+ 295us) client_negotiation.cc:240] Negotiation successful
0811 07:37:50.840657 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":833,"thread_start_us":247,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.195@KRBTEST.COM" created.
I20260811 07:37:50.844259 20424 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37521
I20260811 07:37:50.844658 20424 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:50.845345 20424 heartbeater.cc:511] Master 127.22.4.254:37521 requested a full tablet report, sending...
I20260811 07:37:50.847078 19897 ts_manager.cc:194] Registered new tserver with Master: 86732bc6f275467b989d66332d6b5870 (127.22.4.194:44641)
I20260811 07:37:50.847787 19897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.194@KRBTEST.COM'} at 127.22.4.194:41261
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
Entry for principal kudu/127.22.4.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab.
I20260811 07:37:50.869297 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37521
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34597
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:51.020538 20433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:51.020946 20433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:51.020999 20433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:51.025477 20433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:51.025578 20433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:51.025643 20433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:37:51.031944 20433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34597
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.195.keytab
--principal=kudu/127.22.4.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:37521
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:51.033260 20433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:51.034474 20433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:51.047551 20442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:51.047945 20445 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:51.048034 20433 server_base.cc:1034] running on GCE node
W20260811 07:37:51.047545 20440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:51.049003 20433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:51.050015 20433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:51.051189 20433 hybrid_clock.cc:648] HybridClock initialized: now 1786433871051159 us; error 51 us; skew 500 ppm
Aug 11 07:37:51 dist-test-slave-7z32 krb5kdc[19819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433871, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:51.055272 20433 init.cc:377] Logged in from keytab as kudu/127.22.4.195@KRBTEST.COM (short username kudu)
I20260811 07:37:51.056730 20433 webserver.cc:460] Webserver started at http://127.22.4.195:34573/ using document root <none> and password file <none>
I20260811 07:37:51.057580 20433 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:51.057708 20433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:51.058029 20433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:51.061407 20433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "44af207842b942f78933432378a3c529"
format_stamp: "Formatted at 2026-08-11 07:37:51 on dist-test-slave-7z32"
server_key: "9fce9eabb3c3347d8c7f907d8547a047"
server_key_iv: "8f9132106dbfeb523c8bfaa6371ce058"
server_key_version: "encryptionkey@0"
I20260811 07:37:51.062213 20433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "44af207842b942f78933432378a3c529"
format_stamp: "Formatted at 2026-08-11 07:37:51 on dist-test-slave-7z32"
server_key: "9fce9eabb3c3347d8c7f907d8547a047"
server_key_iv: "8f9132106dbfeb523c8bfaa6371ce058"
server_key_version: "encryptionkey@0"
I20260811 07:37:51.067817 20433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260811 07:37:51.072157 20452 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:51.074374 20433 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:37:51.074666 20433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "44af207842b942f78933432378a3c529"
format_stamp: "Formatted at 2026-08-11 07:37:51 on dist-test-slave-7z32"
server_key: "9fce9eabb3c3347d8c7f907d8547a047"
server_key_iv: "8f9132106dbfeb523c8bfaa6371ce058"
server_key_version: "encryptionkey@0"
I20260811 07:37:51.075131 20433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:51.102180 20433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:51.107146 20433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:51.107406 20433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:51.108354 20433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:51.109611 20433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:51.109699 20433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:51.109781 20433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:51.109826 20433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:51.124173 20433 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:32987
I20260811 07:37:51.124262 20625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:32987 every 8 connection(s)
I20260811 07:37:51.125728 20433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:37:51.133728 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 20433
I20260811 07:37:51.133937 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:37:51.134331 22547 external_mini_cluster.cc:1428] Setting key b5e4b48199e91e57a655ba57af6d8a6d
Aug 11 07:37:51 dist-test-slave-7z32 krb5kdc[19819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433871, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.195@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:37:51.146694 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.128897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:38529 (local address 127.22.4.254:37521)
0811 07:37:51.129172 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.129179 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.130900 (+ 1721us) server_negotiation.cc:407] Connection header received
0811 07:37:51.132982 (+ 2082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.132986 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.133088 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.133241 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:51.135446 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.136142 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.137518 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.137748 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.137874 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.141634 (+ 3760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:51.141638 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:51.141642 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:51.141722 (+ 80us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:51.143775 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:51.144739 (+ 964us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:51.144743 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:51.144745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:51.144857 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:51.145296 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:51.145299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:51.145300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:51.145557 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:51.145700 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.146286 (+ 586us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.146439 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100}
I20260811 07:37:51.147698 20634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.129547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:37521 (local address 127.22.4.195:38529)
0811 07:37:51.130577 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:51.130666 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:51.132617 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:51.133710 (+ 1093us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:51.133722 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:51.134409 (+ 687us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:51.135212 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.135231 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.136303 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.136314 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.137369 (+ 1055us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.137381 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.137938 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.137943 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.138137 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.139211 (+ 1074us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:37:51.139231 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:51.141329 (+ 2098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:51.144013 (+ 2684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:51.144021 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:51.144042 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:51.144522 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:51.144973 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:37:51.144985 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:37:51.144986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:37:51.145174 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:37:51.145673 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:51.145680 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:51.146007 (+ 327us) client_negotiation.cc:769] Sending connection context
0811 07:37:51.146203 (+ 196us) client_negotiation.cc:240] Negotiation successful
0811 07:37:51.146578 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":243,"threads_started":1}
I20260811 07:37:51.149236 20627 heartbeater.cc:347] Connected to a master server at 127.22.4.254:37521
I20260811 07:37:51.149554 20627 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:51.150285 20627 heartbeater.cc:511] Master 127.22.4.254:37521 requested a full tablet report, sending...
I20260811 07:37:51.151578 19897 ts_manager.cc:194] Registered new tserver with Master: 44af207842b942f78933432378a3c529 (127.22.4.195:32987)
I20260811 07:37:51.152323 19897 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.22.4.195@KRBTEST.COM'} at 127.22.4.195:38529
I20260811 07:37:51.164309 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:37:51.177170 19959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.167106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42354 (local address 127.22.4.254:37521)
0811 07:37:51.167281 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.167285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.167385 (+ 100us) server_negotiation.cc:407] Connection header received
0811 07:37:51.167521 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.167524 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.167585 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.167697 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:51.168592 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.169198 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.170212 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.170459 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.170559 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.172389 (+ 1830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:51.172393 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:51.172395 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:51.172430 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:51.174348 (+ 1918us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:51.175044 (+ 696us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:51.175047 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:51.175049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:51.175166 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:51.175810 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:51.175813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:51.175815 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:51.176208 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:51.176358 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.176811 (+ 453us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.176974 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:37:51.183099 19897 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42354:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:37:51.187784 19897 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:37:51.213066 20649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.204758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:32987 (local address 127.0.0.1:40984)
0811 07:37:51.205741 (+ 983us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:51.205825 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:51.206056 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:51.207219 (+ 1163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:51.207230 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:51.207266 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:51.207463 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.207472 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.208811 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.208818 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.210547 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.210565 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.212359 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.212363 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.212515 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.212565 (+ 50us) client_negotiation.cc:769] Sending connection context
0811 07:37:51.212700 (+ 135us) client_negotiation.cc:240] Negotiation successful
0811 07:37:51.212859 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"thread_start_us":201,"threads_started":1}
I20260811 07:37:51.213524 20650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.204900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40984 (local address 127.22.4.195:32987)
0811 07:37:51.205794 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.205826 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.205948 (+ 122us) server_negotiation.cc:407] Connection header received
0811 07:37:51.206327 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.206335 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.206618 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.206812 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:51.207631 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.208656 (+ 1025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.210805 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.211929 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.212065 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.212269 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.213100 (+ 831us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.213312 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":801,"thread_start_us":253,"threads_started":1}
I20260811 07:37:51.214146 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.204912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:33057 (local address 127.0.0.1:53748)
0811 07:37:51.205881 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:51.205901 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:51.206058 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:51.207496 (+ 1438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:51.207502 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:51.207529 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:51.207710 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.207723 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.209935 (+ 2212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.209942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.211490 (+ 1548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.211507 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.213589 (+ 2082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.213593 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.213760 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.213798 (+ 38us) client_negotiation.cc:769] Sending connection context
0811 07:37:51.213861 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 07:37:51.213976 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":877,"thread_start_us":145,"threads_started":1}
I20260811 07:37:51.214774 20653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.206668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56004 (local address 127.22.4.194:44641)
0811 07:37:51.207444 (+ 776us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.207462 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.207771 (+ 309us) server_negotiation.cc:407] Connection header received
0811 07:37:51.208023 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.208030 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.208290 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.208439 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:51.209426 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.210615 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.212308 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.213232 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.213341 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.213525 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.214473 (+ 948us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.214630 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":231,"threads_started":1}
I20260811 07:37:51.215104 20651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.205185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53748 (local address 127.22.4.193:33057)
0811 07:37:51.205612 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.205623 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.206024 (+ 401us) server_negotiation.cc:407] Connection header received
0811 07:37:51.206933 (+ 909us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.206942 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.207233 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.207914 (+ 681us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:51.208113 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.209578 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.211919 (+ 2341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.213061 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.214486 (+ 1425us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.214695 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.214761 (+ 66us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.214923 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":95,"threads_started":1}
I20260811 07:37:51.215677 20652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.206487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:44641 (local address 127.0.0.1:56004)
0811 07:37:51.207645 (+ 1158us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:51.207666 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:51.207854 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:51.208916 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:51.208920 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:51.208943 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:51.209153 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.209162 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.210796 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.210799 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.212129 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.212142 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.213836 (+ 1694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.213840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.213971 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.214200 (+ 229us) client_negotiation.cc:769] Sending connection context
0811 07:37:51.215147 (+ 947us) client_negotiation.cc:240] Negotiation successful
0811 07:37:51.215517 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1083,"mutex_wait_us":58,"thread_start_us":134,"threads_started":1}
I20260811 07:37:51.218290 20527 tablet_service.cc:1467] Processing CreateTablet for tablet 45cd322971684f06a8be8aaf78dd97c3 (DEFAULT_TABLE table=test-table [id=9e668ac4094d4e6c9c1c84f5d52f6055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:51.219187 20313 tablet_service.cc:1467] Processing CreateTablet for tablet 45cd322971684f06a8be8aaf78dd97c3 (DEFAULT_TABLE table=test-table [id=9e668ac4094d4e6c9c1c84f5d52f6055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:51.219281 20104 tablet_service.cc:1467] Processing CreateTablet for tablet 45cd322971684f06a8be8aaf78dd97c3 (DEFAULT_TABLE table=test-table [id=9e668ac4094d4e6c9c1c84f5d52f6055]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:51.220453 20313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cd322971684f06a8be8aaf78dd97c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:51.220463 20527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cd322971684f06a8be8aaf78dd97c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:51.220781 20104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 45cd322971684f06a8be8aaf78dd97c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:51.229737 20654 tablet_bootstrap.cc:492] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a: Bootstrap starting.
I20260811 07:37:51.232575 20658 tablet_bootstrap.cc:492] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Bootstrap starting.
I20260811 07:37:51.233407 20654 tablet_bootstrap.cc:654] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:51.232007 20655 tablet_bootstrap.cc:492] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Bootstrap starting.
I20260811 07:37:51.235015 20654 log.cc:824] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:51.237037 20658 tablet_bootstrap.cc:654] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:51.238008 20655 tablet_bootstrap.cc:654] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:51.238524 20658 log.cc:824] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:51.239393 20655 log.cc:824] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:51.239802 20654 tablet_bootstrap.cc:492] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a: No bootstrap required, opened a new log
I20260811 07:37:51.240150 20654 ts_tablet_manager.cc:1397] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260811 07:37:51.241925 20658 tablet_bootstrap.cc:492] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: No bootstrap required, opened a new log
I20260811 07:37:51.242529 20658 ts_tablet_manager.cc:1397] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260811 07:37:51.243076 20655 tablet_bootstrap.cc:492] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: No bootstrap required, opened a new log
I20260811 07:37:51.243361 20655 ts_tablet_manager.cc:1397] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260811 07:37:51.247191 20654 raft_consensus.cc:348] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.247711 20654 raft_consensus.cc:374] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:51.247792 20654 raft_consensus.cc:729] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729c635ed72b497bb77915f1e7f9dd2a, State: Initialized, Role: FOLLOWER
I20260811 07:37:51.248052 20655 raft_consensus.cc:348] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.248383 20655 raft_consensus.cc:374] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:51.248443 20655 raft_consensus.cc:729] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44af207842b942f78933432378a3c529, State: Initialized, Role: FOLLOWER
I20260811 07:37:51.248157 20658 raft_consensus.cc:348] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.248497 20654 consensus_queue.cc:260] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.248624 20658 raft_consensus.cc:374] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:51.248694 20658 raft_consensus.cc:729] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86732bc6f275467b989d66332d6b5870, State: Initialized, Role: FOLLOWER
I20260811 07:37:51.248857 20655 consensus_queue.cc:260] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.249284 20658 consensus_queue.cc:260] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.249876 20627 heartbeater.cc:503] Master 127.22.4.254:37521 was elected leader, sending a full tablet report...
I20260811 07:37:51.250079 20655 ts_tablet_manager.cc:1428] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260811 07:37:51.250079 20654 ts_tablet_manager.cc:1428] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s
I20260811 07:37:51.250562 20210 heartbeater.cc:503] Master 127.22.4.254:37521 was elected leader, sending a full tablet report...
I20260811 07:37:51.251107 20424 heartbeater.cc:503] Master 127.22.4.254:37521 was elected leader, sending a full tablet report...
I20260811 07:37:51.251899 20658 ts_tablet_manager.cc:1428] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
W20260811 07:37:51.321857 20425 tablet.cc:2369] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:37:51.377393 20630 tablet.cc:2369] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:51.425326 20668 raft_consensus.cc:482] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:51.425729 20668 raft_consensus.cc:504] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.427677 20668 leader_election.cc:288] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 44af207842b942f78933432378a3c529 (127.22.4.195:32987), 729c635ed72b497bb77915f1e7f9dd2a (127.22.4.193:33057)
I20260811 07:37:51.435071 20651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.428514 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:59919 (local address 127.22.4.193:33057)
0811 07:37:51.428695 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.428702 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.428733 (+ 31us) server_negotiation.cc:407] Connection header received
0811 07:37:51.429111 (+ 378us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.429115 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.429193 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.429336 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:51.429921 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.430758 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.433236 (+ 2478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.433999 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.434192 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.434260 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.434739 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.434873 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:37:51.435071 20650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.428314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:45597 (local address 127.22.4.195:32987)
0811 07:37:51.428594 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.428602 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.429057 (+ 455us) server_negotiation.cc:407] Connection header received
0811 07:37:51.429136 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.429139 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.429198 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.429331 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:51.429921 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.430758 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.433236 (+ 2478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.433999 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.434192 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.434260 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.434739 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.434873 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174}
I20260811 07:37:51.435166 20672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.428261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:32987 (local address 127.22.4.194:45597)
0811 07:37:51.428804 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:51.428819 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:51.428940 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:51.429388 (+ 448us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:51.429392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:51.429452 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:51.429688 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.429694 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.430990 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.430994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.432978 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.432995 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.434216 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.434221 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.434488 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.434547 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 07:37:51.434662 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 07:37:51.434889 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":454,"mutex_wait_us":277,"spinlock_wait_cycles":52480,"thread_start_us":145,"threads_started":1}
I20260811 07:37:51.435462 20669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.428134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:33057 (local address 127.22.4.194:59919)
0811 07:37:51.428592 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:51.428614 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:51.428796 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:51.429388 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:51.429392 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:51.429453 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:51.429684 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.429693 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.430990 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.430994 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.432978 (+ 1984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:51.432995 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.434216 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.434221 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:51.434458 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.434541 (+ 83us) client_negotiation.cc:769] Sending connection context
0811 07:37:51.434653 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 07:37:51.434889 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":410,"spinlock_wait_cycles":7552,"thread_start_us":145,"threads_started":1}
I20260811 07:37:51.436511 20556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cd322971684f06a8be8aaf78dd97c3" candidate_uuid: "86732bc6f275467b989d66332d6b5870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44af207842b942f78933432378a3c529" is_pre_election: true
I20260811 07:37:51.436511 20132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cd322971684f06a8be8aaf78dd97c3" candidate_uuid: "86732bc6f275467b989d66332d6b5870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729c635ed72b497bb77915f1e7f9dd2a" is_pre_election: true
I20260811 07:37:51.437038 20132 raft_consensus.cc:2454] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86732bc6f275467b989d66332d6b5870 in term 0.
I20260811 07:37:51.437038 20556 raft_consensus.cc:2454] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 86732bc6f275467b989d66332d6b5870 in term 0.
I20260811 07:37:51.437850 20248 leader_election.cc:302] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 44af207842b942f78933432378a3c529, 729c635ed72b497bb77915f1e7f9dd2a, 86732bc6f275467b989d66332d6b5870; no voters:
I20260811 07:37:51.438406 20668 raft_consensus.cc:2781] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:37:51.438608 20668 raft_consensus.cc:482] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:37:51.438696 20668 raft_consensus.cc:3037] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:51.440205 20668 raft_consensus.cc:504] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.440744 20668 leader_election.cc:288] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [CANDIDATE]: Term 1 election: Requested vote from peers 44af207842b942f78933432378a3c529 (127.22.4.195:32987), 729c635ed72b497bb77915f1e7f9dd2a (127.22.4.193:33057)
I20260811 07:37:51.441753 20556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cd322971684f06a8be8aaf78dd97c3" candidate_uuid: "86732bc6f275467b989d66332d6b5870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "44af207842b942f78933432378a3c529"
I20260811 07:37:51.441752 20132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "45cd322971684f06a8be8aaf78dd97c3" candidate_uuid: "86732bc6f275467b989d66332d6b5870" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729c635ed72b497bb77915f1e7f9dd2a"
I20260811 07:37:51.442025 20556 raft_consensus.cc:3037] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:51.442025 20132 raft_consensus.cc:3037] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:51.444314 20132 raft_consensus.cc:2454] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86732bc6f275467b989d66332d6b5870 in term 1.
I20260811 07:37:51.444314 20556 raft_consensus.cc:2454] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 86732bc6f275467b989d66332d6b5870 in term 1.
I20260811 07:37:51.445379 20244 leader_election.cc:302] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 44af207842b942f78933432378a3c529, 729c635ed72b497bb77915f1e7f9dd2a, 86732bc6f275467b989d66332d6b5870; no voters:
I20260811 07:37:51.446331 20668 raft_consensus.cc:2781] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:51.447149 20668 raft_consensus.cc:686] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 1 LEADER]: Becoming Leader. State: Replica: 86732bc6f275467b989d66332d6b5870, State: Running, Role: LEADER
I20260811 07:37:51.447804 20668 consensus_queue.cc:237] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } }
I20260811 07:37:51.452973 19897 catalog_manager.cc:5495] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 reported cstate change: term changed from 0 to 1, leader changed from <none> to 86732bc6f275467b989d66332d6b5870 (127.22.4.194). New cstate: current_term: 1 leader_uuid: "86732bc6f275467b989d66332d6b5870" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "86732bc6f275467b989d66332d6b5870" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 44641 } health_report { overall_health: HEALTHY } } }
W20260811 07:37:51.482714 20212 tablet.cc:2369] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:51.518208 20653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.513191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56010 (local address 127.22.4.194:44641)
0811 07:37:51.513422 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.513429 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.513448 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:37:51.513599 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.513602 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.513682 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.513818 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:37:51.514208 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.514795 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.515866 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.516101 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.516222 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.516623 (+ 401us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:37:51.517524 (+ 901us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:37:51.517832 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.517885 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.517983 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114}
I20260811 07:37:51.527891 20132 raft_consensus.cc:1261] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [term 1 FOLLOWER]: Refusing update from remote peer 86732bc6f275467b989d66332d6b5870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:51.527910 20556 raft_consensus.cc:1261] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 1 FOLLOWER]: Refusing update from remote peer 86732bc6f275467b989d66332d6b5870: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:51.528980 20668 consensus_queue.cc:1035] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "44af207842b942f78933432378a3c529" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:51.529330 20673 consensus_queue.cc:1035] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729c635ed72b497bb77915f1e7f9dd2a" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 33057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:51.541574 20676 mvcc.cc:205] Tried to move back new op lower bound from 7317233137764466688 to 7317233137454178304. Current Snapshot: MvccSnapshot[applied={T|T < 7317233137764466688}]
I20260811 07:37:51.543887 20680 mvcc.cc:205] Tried to move back new op lower bound from 7317233137764466688 to 7317233137454178304. Current Snapshot: MvccSnapshot[applied={T|T < 7317233137764466688}]
I20260811 07:37:51.553814 19897 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:51.554095 19897 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42354:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:51.557772 19897 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 02001939bf9a4765928e7e1ab5d91820: Sending DeleteTablet for 3 replicas of tablet 45cd322971684f06a8be8aaf78dd97c3
I20260811 07:37:51.559033 20527 tablet_service.cc:1514] Processing DeleteTablet for tablet 45cd322971684f06a8be8aaf78dd97c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:51 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:40984
I20260811 07:37:51.559167 20313 tablet_service.cc:1514] Processing DeleteTablet for tablet 45cd322971684f06a8be8aaf78dd97c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:51 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:56004
I20260811 07:37:51.559142 20104 tablet_service.cc:1514] Processing DeleteTablet for tablet 45cd322971684f06a8be8aaf78dd97c3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:51 UTC) from {username='kudu', principal='kudu/127.22.4.254@KRBTEST.COM'} at 127.0.0.1:53748
I20260811 07:37:51.559760 20695 tablet_replica.cc:330] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: stopping tablet replica
I20260811 07:37:51.560220 20695 raft_consensus.cc:2229] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 1 LEADER]: Raft consensus shutting down.
I20260811 07:37:51.560271 20694 tablet_replica.cc:330] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: stopping tablet replica
I20260811 07:37:51.560552 20694 raft_consensus.cc:2229] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:51.560801 20695 raft_consensus.cc:2258] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:51.560889 20694 raft_consensus.cc:2258] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:51.561311 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 19998
I20260811 07:37:51.561439 20696 tablet_replica.cc:330] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a: stopping tablet replica
I20260811 07:37:51.561758 20696 raft_consensus.cc:2229] T 45cd322971684f06a8be8aaf78dd97c3 P 729c635ed72b497bb77915f1e7f9dd2a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:51.567286 20694 ts_tablet_manager.cc:1905] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:51.572511 20694 ts_tablet_manager.cc:1918] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:51.572705 20694 log.cc:1196] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/45cd322971684f06a8be8aaf78dd97c3
I20260811 07:37:51.573247 20694 ts_tablet_manager.cc:1939] T 45cd322971684f06a8be8aaf78dd97c3 P 44af207842b942f78933432378a3c529: Deleting consensus metadata
I20260811 07:37:51.576668 19867 catalog_manager.cc:4841] TS 44af207842b942f78933432378a3c529 (127.22.4.195:32987): tablet 45cd322971684f06a8be8aaf78dd97c3 (table test-table [id=9e668ac4094d4e6c9c1c84f5d52f6055]) successfully deleted
I20260811 07:37:51.577217 20695 ts_tablet_manager.cc:1905] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:51.581308 20695 ts_tablet_manager.cc:1918] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:51.581489 20695 log.cc:1196] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/45cd322971684f06a8be8aaf78dd97c3
I20260811 07:37:51.581880 20695 ts_tablet_manager.cc:1939] T 45cd322971684f06a8be8aaf78dd97c3 P 86732bc6f275467b989d66332d6b5870: Deleting consensus metadata
I20260811 07:37:51.583554 19871 catalog_manager.cc:4841] TS 86732bc6f275467b989d66332d6b5870 (127.22.4.194:44641): tablet 45cd322971684f06a8be8aaf78dd97c3 (table test-table [id=9e668ac4094d4e6c9c1c84f5d52f6055]) successfully deleted
W20260811 07:37:51.592175 19875 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:33057 (error 108)
I20260811 07:37:51.593129 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 20218
I20260811 07:37:51.603308 20652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.602653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:33057 (local address 127.0.0.1:53754)
0811 07:37:51.603057 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:51.603192 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:33057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260811 07:37:51.603754 19875 catalog_manager.cc:4584] TS 729c635ed72b497bb77915f1e7f9dd2a (127.22.4.193:33057): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 45cd322971684f06a8be8aaf78dd97c3: Network error: Client connection negotiation failed: client connection to 127.22.4.193:33057: connect: Connection refused (error 111)
I20260811 07:37:51.612018 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 20433
I20260811 07:37:51.625475 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 19836
2026-08-11T07:37:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (3474 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T07:37:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:51Z Disabled control of system clock
I20260811 07:37:51.686349 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:46579
--webserver_interface=127.22.4.254
--webserver_port=0
--builtin_ntp_servers=127.22.4.212:39635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:46579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:37:51.816807 20708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:51.817245 20708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:51.817417 20708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:51.822032 20708 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:51.822140 20708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:51.822157 20708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:51.822175 20708 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:51.822191 20708 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:51.827775 20708 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:46579
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:46579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:51.829128 20708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:51.830698 20708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:51.843788 20716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:51.843900 20708 server_base.cc:1034] running on GCE node
W20260811 07:37:51.843745 20715 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:51.843708 20718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:51.845284 20708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:51.847124 20708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:51.848631 20708 hybrid_clock.cc:648] HybridClock initialized: now 1786433871848577 us; error 85 us; skew 500 ppm
I20260811 07:37:51.851565 20708 webserver.cc:460] Webserver started at http://127.22.4.254:45425/ using document root <none> and password file <none>
I20260811 07:37:51.852385 20708 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:51.852478 20708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:51.852742 20708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:51.855753 20708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "176e2bc6ce2344a58b1706fa3cc41b5b"
format_stamp: "Formatted at 2026-08-11 07:37:51 on dist-test-slave-7z32"
server_key: "c783bc662f400d8f9b4b1ddcc7b4e6af"
server_key_iv: "877024f368a094667b1741d819dd9e1a"
server_key_version: "encryptionkey@0"
I20260811 07:37:51.856586 20708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "176e2bc6ce2344a58b1706fa3cc41b5b"
format_stamp: "Formatted at 2026-08-11 07:37:51 on dist-test-slave-7z32"
server_key: "c783bc662f400d8f9b4b1ddcc7b4e6af"
server_key_iv: "877024f368a094667b1741d819dd9e1a"
server_key_version: "encryptionkey@0"
I20260811 07:37:51.861999 20708 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:37:51.865852 20727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:51.868219 20708 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:37:51.868484 20708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "176e2bc6ce2344a58b1706fa3cc41b5b"
format_stamp: "Formatted at 2026-08-11 07:37:51 on dist-test-slave-7z32"
server_key: "c783bc662f400d8f9b4b1ddcc7b4e6af"
server_key_iv: "877024f368a094667b1741d819dd9e1a"
server_key_version: "encryptionkey@0"
I20260811 07:37:51.868677 20708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:51.886010 20708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:51.887097 20708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:51.887365 20708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:51.898705 20708 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:46579
I20260811 07:37:51.898916 20813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:46579 every 8 connection(s)
I20260811 07:37:51.900036 20708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:51.904808 20814 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:51.907454 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 20708
I20260811 07:37:51.907652 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:51.908046 22547 external_mini_cluster.cc:1428] Setting key eda9964c056a27a5b16137f6ed9ecc85
I20260811 07:37:51.913839 20814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b: Bootstrap starting.
I20260811 07:37:51.917421 20814 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:51.918705 20814 log.cc:824] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:51.921645 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:51.910201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57180 (local address 127.22.4.254:46579)
0811 07:37:51.911488 (+ 1287us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:51.911521 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:51.911577 (+ 56us) server_negotiation.cc:407] Connection header received
0811 07:37:51.912574 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:51.912596 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:51.913185 (+ 589us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:51.913637 (+ 452us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:51.914193 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.915327 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.916279 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:51.917086 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:51.917334 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:51.918402 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:51.918408 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:51.918428 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:51.919242 (+ 814us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:51.919354 (+ 112us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:51.919393 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:51.919649 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:51.920110 (+ 461us) server_negotiation.cc:299] Negotiation successful
0811 07:37:51.920574 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":234,"threads_started":1}
I20260811 07:37:51.922107 20814 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b: No bootstrap required, opened a new log
I20260811 07:37:51.926637 20814 raft_consensus.cc:348] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e2bc6ce2344a58b1706fa3cc41b5b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46579 } }
I20260811 07:37:51.927052 20814 raft_consensus.cc:374] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:51.927098 20814 raft_consensus.cc:729] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176e2bc6ce2344a58b1706fa3cc41b5b, State: Initialized, Role: FOLLOWER
I20260811 07:37:51.927573 20814 consensus_queue.cc:260] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e2bc6ce2344a58b1706fa3cc41b5b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46579 } }
I20260811 07:37:51.927713 20814 raft_consensus.cc:388] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:51.927770 20814 raft_consensus.cc:482] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:51.927865 20814 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:51.929065 20814 raft_consensus.cc:504] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e2bc6ce2344a58b1706fa3cc41b5b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46579 } }
I20260811 07:37:51.929517 20814 leader_election.cc:302] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 176e2bc6ce2344a58b1706fa3cc41b5b; no voters:
I20260811 07:37:51.930001 20814 leader_election.cc:288] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:51.930094 20822 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:51.930362 20822 raft_consensus.cc:686] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [term 1 LEADER]: Becoming Leader. State: Replica: 176e2bc6ce2344a58b1706fa3cc41b5b, State: Running, Role: LEADER
I20260811 07:37:51.930766 20822 consensus_queue.cc:237] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e2bc6ce2344a58b1706fa3cc41b5b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46579 } }
I20260811 07:37:51.931725 20814 sys_catalog.cc:564] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:51.933073 20823 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 176e2bc6ce2344a58b1706fa3cc41b5b. Latest consensus state: current_term: 1 leader_uuid: "176e2bc6ce2344a58b1706fa3cc41b5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e2bc6ce2344a58b1706fa3cc41b5b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46579 } } }
I20260811 07:37:51.933277 20823 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:51.933785 20844 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:51.933030 20826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "176e2bc6ce2344a58b1706fa3cc41b5b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "176e2bc6ce2344a58b1706fa3cc41b5b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46579 } } }
I20260811 07:37:51.935096 20826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:51.937987 20844 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:51.945544 20844 catalog_manager.cc:1347] Generated new cluster ID: f7b0bc37d5804871a43924eb8c6c03f8
I20260811 07:37:51.945663 20844 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:51.977597 20844 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:51.979254 20844 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:51.996569 20844 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b: Generated new TSK 0
I20260811 07:37:51.998000 20844 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:37:52.012930 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.193:0
--local_ip_for_outbound_sockets=127.22.4.193
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46579
--builtin_ntp_servers=127.22.4.212:39635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 07:37:52.151516 20856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:52.151867 20856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:52.151937 20856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:52.157042 20856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:52.157168 20856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:52.157266 20856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.193
I20260811 07:37:52.162564 20856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.22.4.193
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.193
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:52.164237 20856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:52.165853 20856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:52.178010 20866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:52.178154 20868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:52.178030 20863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:52.178651 20856 server_base.cc:1034] running on GCE node
I20260811 07:37:52.179232 20856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:52.180002 20856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:52.181234 20856 hybrid_clock.cc:648] HybridClock initialized: now 1786433872181201 us; error 56 us; skew 500 ppm
I20260811 07:37:52.184231 20856 webserver.cc:460] Webserver started at http://127.22.4.193:39625/ using document root <none> and password file <none>
I20260811 07:37:52.184965 20856 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:52.185074 20856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:52.185333 20856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:52.187812 20856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/data/instance:
uuid: "bdf686a39418465884cf9e0eec1c0b42"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "697e0e57d71641cf86d67f10086f0cdd"
server_key_iv: "670ba262148d37c433222ed9d29ea96f"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.188468 20856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance:
uuid: "bdf686a39418465884cf9e0eec1c0b42"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "697e0e57d71641cf86d67f10086f0cdd"
server_key_iv: "670ba262148d37c433222ed9d29ea96f"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.193300 20856 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:37:52.196775 20875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.198966 20856 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:37:52.199172 20856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/wal
uuid: "bdf686a39418465884cf9e0eec1c0b42"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "697e0e57d71641cf86d67f10086f0cdd"
server_key_iv: "670ba262148d37c433222ed9d29ea96f"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.199334 20856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:52.233944 20856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:52.234858 20856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:52.235114 20856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:52.235898 20856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:52.237049 20856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:52.237126 20856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.237206 20856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:52.237248 20856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.249907 20856 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.193:45479
I20260811 07:37:52.249974 21056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.193:45479 every 8 connection(s)
I20260811 07:37:52.251195 20856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/data/info.pb
I20260811 07:37:52.255524 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 20856
I20260811 07:37:52.255712 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-0/wal/instance
I20260811 07:37:52.256214 22547 external_mini_cluster.cc:1428] Setting key 4354247dfd3c6be5acfc553a224526f7
I20260811 07:37:52.258792 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.194:0
--local_ip_for_outbound_sockets=127.22.4.194
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46579
--builtin_ntp_servers=127.22.4.212:39635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:37:52.264568 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.254127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:57231 (local address 127.22.4.254:46579)
0811 07:37:52.254321 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:52.254326 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:52.256064 (+ 1738us) server_negotiation.cc:407] Connection header received
0811 07:37:52.258072 (+ 2008us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:52.258076 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:52.258153 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:52.258293 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:52.259666 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.260278 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.261621 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.261880 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.262003 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.263838 (+ 1835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:52.263843 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:52.263846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:52.263900 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:52.263938 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:52.263950 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:52.264049 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:52.264315 (+ 266us) server_negotiation.cc:299] Negotiation successful
0811 07:37:52.264421 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260811 07:37:52.266465 21059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.254440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46579 (local address 127.22.4.193:57231)
0811 07:37:52.255707 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:52.255794 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:52.257734 (+ 1940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:52.258560 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:52.258570 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:52.258697 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:52.259488 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.259505 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.260435 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.260439 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.261477 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.261488 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.262077 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.262081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.262318 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.263331 (+ 1013us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:52.263336 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:52.263412 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:52.263555 (+ 143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:52.264078 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:52.264092 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:52.264103 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 07:37:52.264287 (+ 184us) client_negotiation.cc:240] Negotiation successful
0811 07:37:52.264761 (+ 474us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"thread_start_us":166,"threads_started":1}
I20260811 07:37:52.268380 21057 heartbeater.cc:347] Connected to a master server at 127.22.4.254:46579
I20260811 07:37:52.268862 21057 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:52.269915 21057 heartbeater.cc:511] Master 127.22.4.254:46579 requested a full tablet report, sending...
I20260811 07:37:52.272258 20755 ts_manager.cc:194] Registered new tserver with Master: bdf686a39418465884cf9e0eec1c0b42 (127.22.4.193:45479)
I20260811 07:37:52.273752 20755 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.193:57231
W20260811 07:37:52.412716 21060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:52.413142 21060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:52.413228 21060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:52.419721 21060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:52.419813 21060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:52.419903 21060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.194
I20260811 07:37:52.425454 21060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.22.4.194
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.194
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:52.426887 21060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:52.428467 21060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:52.442040 21071 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:52.442479 21067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:52.442476 21069 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:52.442849 21060 server_base.cc:1034] running on GCE node
I20260811 07:37:52.443420 21060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:52.444226 21060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:52.445482 21060 hybrid_clock.cc:648] HybridClock initialized: now 1786433872445466 us; error 76 us; skew 500 ppm
I20260811 07:37:52.448212 21060 webserver.cc:460] Webserver started at http://127.22.4.194:33651/ using document root <none> and password file <none>
I20260811 07:37:52.449064 21060 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:52.449178 21060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:52.449467 21060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:52.452090 21060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/data/instance:
uuid: "0991c75b167e40ce94120b7cc1b17cd3"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "dee88dd5731ddecad2fba07394dc8150"
server_key_iv: "62366232d23507097034ae65ef46d523"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.452812 21060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance:
uuid: "0991c75b167e40ce94120b7cc1b17cd3"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "dee88dd5731ddecad2fba07394dc8150"
server_key_iv: "62366232d23507097034ae65ef46d523"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.458041 21060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:37:52.461665 21081 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.463583 21060 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:37:52.463775 21060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/wal
uuid: "0991c75b167e40ce94120b7cc1b17cd3"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "dee88dd5731ddecad2fba07394dc8150"
server_key_iv: "62366232d23507097034ae65ef46d523"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.463934 21060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:52.496886 21060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:52.498129 21060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:52.498525 21060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:52.499455 21060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:52.500711 21060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:52.500783 21060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.500831 21060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:52.500849 21060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.513401 21060 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.194:35707
I20260811 07:37:52.513453 21261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.194:35707 every 8 connection(s)
I20260811 07:37:52.514588 21060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/data/info.pb
I20260811 07:37:52.522234 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 21060
I20260811 07:37:52.522468 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/wal/instance
I20260811 07:37:52.523135 22547 external_mini_cluster.cc:1428] Setting key f4c2a7ff5937f4e0f8d18a59bef6ab7a
I20260811 07:37:52.527464 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.22.4.195:0
--local_ip_for_outbound_sockets=127.22.4.195
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46579
--builtin_ntp_servers=127.22.4.212:39635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 07:37:52.535701 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.517837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.194:42697 (local address 127.22.4.254:46579)
0811 07:37:52.518033 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:52.518037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:52.520162 (+ 2125us) server_negotiation.cc:407] Connection header received
0811 07:37:52.522705 (+ 2543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:52.522710 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:52.522873 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:52.523071 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:52.525750 (+ 2679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.527181 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.531269 (+ 4088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.531805 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.532344 (+ 539us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.534907 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:52.534912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:52.534915 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:52.534940 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:52.534971 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:52.534982 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:52.535082 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:52.535326 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 07:37:52.535453 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260811 07:37:52.537438 21265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.518144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46579 (local address 127.22.4.194:42697)
0811 07:37:52.519870 (+ 1726us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:52.519951 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:52.521982 (+ 2031us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:52.523513 (+ 1531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:52.523531 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:52.523926 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:52.525103 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.525133 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.527521 (+ 2388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.527527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.530768 (+ 3241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.530812 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.532447 (+ 1635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.532453 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.532876 (+ 423us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.534267 (+ 1391us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:52.534272 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:52.534366 (+ 94us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:52.534516 (+ 150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:52.535093 (+ 577us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:52.535109 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:52.535123 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 07:37:52.535322 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 07:37:52.535924 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"thread_start_us":380,"threads_started":1}
I20260811 07:37:52.539971 21263 heartbeater.cc:347] Connected to a master server at 127.22.4.254:46579
I20260811 07:37:52.540448 21263 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:52.541487 21263 heartbeater.cc:511] Master 127.22.4.254:46579 requested a full tablet report, sending...
I20260811 07:37:52.543715 20755 ts_manager.cc:194] Registered new tserver with Master: 0991c75b167e40ce94120b7cc1b17cd3 (127.22.4.194:35707)
I20260811 07:37:52.544972 20755 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.194:42697
W20260811 07:37:52.677054 21266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:52.677425 21266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:52.677479 21266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:52.682055 21266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:52.682168 21266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:52.682230 21266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.4.195
I20260811 07:37:52.690240 21266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.22.4.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.22.4.195
--webserver_port=0
--tserver_master_addrs=127.22.4.254:46579
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.22.4.195
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:52.691686 21266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:52.693197 21266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:52.706202 21273 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:52.706184 21276 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:52.706447 21266 server_base.cc:1034] running on GCE node
W20260811 07:37:52.706202 21272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:52.707365 21266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:52.708443 21266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:52.709885 21266 hybrid_clock.cc:648] HybridClock initialized: now 1786433872709832 us; error 68 us; skew 500 ppm
I20260811 07:37:52.712604 21266 webserver.cc:460] Webserver started at http://127.22.4.195:35381/ using document root <none> and password file <none>
I20260811 07:37:52.713328 21266 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:52.713407 21266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:52.713665 21266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:52.716233 21266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/data/instance:
uuid: "a87e3a55ef834f0c9718979bb1af32f0"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "32407718072c2e38a7cf8991960286a0"
server_key_iv: "14a88f691ce8802faa7b8ac8b6900628"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.716903 21266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance:
uuid: "a87e3a55ef834f0c9718979bb1af32f0"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "32407718072c2e38a7cf8991960286a0"
server_key_iv: "14a88f691ce8802faa7b8ac8b6900628"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.722225 21266 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:37:52.726101 21284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.728253 21266 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:37:52.728503 21266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/wal
uuid: "a87e3a55ef834f0c9718979bb1af32f0"
format_stamp: "Formatted at 2026-08-11 07:37:52 on dist-test-slave-7z32"
server_key: "32407718072c2e38a7cf8991960286a0"
server_key_iv: "14a88f691ce8802faa7b8ac8b6900628"
server_key_version: "encryptionkey@0"
I20260811 07:37:52.728672 21266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:52.759881 21266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:52.760761 21266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:52.761003 21266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:52.761713 21266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 07:37:52.763015 21266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 07:37:52.763087 21266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.763164 21266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 07:37:52.763204 21266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:52.777267 21266 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.195:33245
I20260811 07:37:52.777309 21450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.195:33245 every 8 connection(s)
I20260811 07:37:52.778470 21266 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/data/info.pb
I20260811 07:37:52.783107 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 21266
I20260811 07:37:52.783304 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/wal/instance
I20260811 07:37:52.783744 22547 external_mini_cluster.cc:1428] Setting key 186a5d322d0604128de5a3bbbc28ac8a
I20260811 07:37:52.791767 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.781267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.195:52733 (local address 127.22.4.254:46579)
0811 07:37:52.781445 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:52.781449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:52.783026 (+ 1577us) server_negotiation.cc:407] Connection header received
0811 07:37:52.785316 (+ 2290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:52.785321 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:52.785400 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:52.785483 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:52.786808 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.787454 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.788937 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.789214 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.789346 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.791047 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:52.791051 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:52.791054 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:52.791082 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:52.791108 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:52.791118 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:52.791226 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:52.791442 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 07:37:52.791550 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260811 07:37:52.793282 21453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.781621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46579 (local address 127.22.4.195:52733)
0811 07:37:52.782709 (+ 1088us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:52.782797 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:52.784968 (+ 2171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:52.785781 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:52.785791 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:52.785921 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:37:52.786629 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.786647 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.787631 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.787635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.788764 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.788778 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.789438 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.789442 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.789682 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.790526 (+ 844us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 07:37:52.790528 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:37:52.790615 (+ 87us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 07:37:52.790747 (+ 132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:37:52.791241 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:37:52.791255 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:37:52.791269 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 07:37:52.791437 (+ 168us) client_negotiation.cc:240] Negotiation successful
0811 07:37:52.791899 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":151,"threads_started":1}
I20260811 07:37:52.795611 21451 heartbeater.cc:347] Connected to a master server at 127.22.4.254:46579
I20260811 07:37:52.795995 21451 heartbeater.cc:464] Registering TS with master...
I20260811 07:37:52.796891 21451 heartbeater.cc:511] Master 127.22.4.254:46579 requested a full tablet report, sending...
I20260811 07:37:52.798507 20755 ts_manager.cc:194] Registered new tserver with Master: a87e3a55ef834f0c9718979bb1af32f0 (127.22.4.195:33245)
I20260811 07:37:52.799690 22547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 07:37:52.799779 20755 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.22.4.195:52733
I20260811 07:37:52.808625 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.802669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57192 (local address 127.22.4.254:46579)
0811 07:37:52.802886 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:52.802891 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:52.803212 (+ 321us) server_negotiation.cc:407] Connection header received
0811 07:37:52.803355 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:52.803358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:52.803421 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:52.803532 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:52.804223 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.804888 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.806040 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.806285 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.806469 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.807808 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:52.807812 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:52.807815 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:52.807836 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:52.807869 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:52.807880 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:52.807970 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:52.808214 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 07:37:52.808402 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:37:52.812947 20755 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 07:37:52.816634 20755 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 07:37:52.837503 21472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.828836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:33245 (local address 127.0.0.1:35126)
0811 07:37:52.829970 (+ 1134us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:52.829985 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:52.830081 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:52.831867 (+ 1786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:52.831871 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:52.831888 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:52.832298 (+ 410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.832311 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.834224 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.834231 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.835433 (+ 1202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.835446 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.836634 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.836638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.837003 (+ 365us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.837081 (+ 78us) client_negotiation.cc:769] Sending connection context
0811 07:37:52.837204 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 07:37:52.837344 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1049,"mutex_wait_us":37,"thread_start_us":181,"threads_started":1}
I20260811 07:37:52.837886 21466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.829018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:45479 (local address 127.0.0.1:58014)
0811 07:37:52.830320 (+ 1302us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:52.830338 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:52.830427 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:52.831724 (+ 1297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:52.831727 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:52.831753 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:52.832273 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.832289 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.834154 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.834158 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.835477 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.835484 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.837370 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.837378 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.837454 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.837478 (+ 24us) client_negotiation.cc:769] Sending connection context
0811 07:37:52.837553 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 07:37:52.837685 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1219,"mutex_wait_us":56,"thread_start_us":130,"threads_started":1}
I20260811 07:37:52.838122 21474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.830147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58014 (local address 127.22.4.193:45479)
0811 07:37:52.830725 (+ 578us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:52.830735 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:52.830769 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:37:52.830918 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:52.830925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:52.831255 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:52.831469 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:52.832457 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.833992 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.835660 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.836574 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.837058 (+ 484us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.837308 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:52.837695 (+ 387us) server_negotiation.cc:299] Negotiation successful
0811 07:37:52.837923 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":450,"thread_start_us":130,"threads_started":1}
I20260811 07:37:52.838387 21469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.828815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:35707 (local address 127.0.0.1:56718)
0811 07:37:52.829395 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:52.829489 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:52.829663 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:52.831490 (+ 1827us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:52.831498 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:52.831527 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:52.831728 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.831742 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.833601 (+ 1859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.833605 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.835469 (+ 1864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:52.835484 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.836805 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.836811 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:52.837970 (+ 1159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.838002 (+ 32us) client_negotiation.cc:769] Sending connection context
0811 07:37:52.838095 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 07:37:52.838214 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":1043,"thread_start_us":117,"threads_started":1}
I20260811 07:37:52.839038 21477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.830153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56718 (local address 127.22.4.194:35707)
0811 07:37:52.830719 (+ 566us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:52.830735 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:52.830769 (+ 34us) server_negotiation.cc:407] Connection header received
0811 07:37:52.830918 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:52.830925 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:52.831249 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:52.831469 (+ 220us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:52.831959 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.833442 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.835680 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.836585 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.836991 (+ 406us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.837308 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:52.838388 (+ 1080us) server_negotiation.cc:299] Negotiation successful
0811 07:37:52.838809 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":431,"thread_start_us":159,"threads_started":1}
I20260811 07:37:52.839326 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:52.830056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35126 (local address 127.22.4.195:33245)
0811 07:37:52.831176 (+ 1120us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:52.831187 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:52.831214 (+ 27us) server_negotiation.cc:407] Connection header received
0811 07:37:52.831303 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:52.831308 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:52.831645 (+ 337us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:52.831924 (+ 279us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:52.832489 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.834092 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.835576 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:52.836482 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:52.838644 (+ 2162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:52.838956 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:52.839008 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 07:37:52.839095 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":990,"thread_start_us":224,"threads_started":1}
I20260811 07:37:52.842602 20952 tablet_service.cc:1467] Processing CreateTablet for tablet f6729d722034400890aadcd5aa608296 (DEFAULT_TABLE table=test-table [id=8fbb3bfc58144db8856547625080301e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:52.842969 21161 tablet_service.cc:1467] Processing CreateTablet for tablet f6729d722034400890aadcd5aa608296 (DEFAULT_TABLE table=test-table [id=8fbb3bfc58144db8856547625080301e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:52.842976 21352 tablet_service.cc:1467] Processing CreateTablet for tablet f6729d722034400890aadcd5aa608296 (DEFAULT_TABLE table=test-table [id=8fbb3bfc58144db8856547625080301e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 07:37:52.844229 20952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6729d722034400890aadcd5aa608296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:52.844480 21161 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6729d722034400890aadcd5aa608296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:52.844480 21352 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6729d722034400890aadcd5aa608296. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:52.854038 21479 tablet_bootstrap.cc:492] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42: Bootstrap starting.
I20260811 07:37:52.855285 21481 tablet_bootstrap.cc:492] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Bootstrap starting.
I20260811 07:37:52.854751 21480 tablet_bootstrap.cc:492] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Bootstrap starting.
I20260811 07:37:52.857810 21479 tablet_bootstrap.cc:654] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:52.858623 21481 tablet_bootstrap.cc:654] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:52.858623 21480 tablet_bootstrap.cc:654] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:52.858877 21479 log.cc:824] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:52.860083 21480 log.cc:824] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:52.860083 21481 log.cc:824] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:52.861701 21479 tablet_bootstrap.cc:492] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42: No bootstrap required, opened a new log
I20260811 07:37:52.861969 21479 ts_tablet_manager.cc:1397] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260811 07:37:52.863009 21481 tablet_bootstrap.cc:492] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: No bootstrap required, opened a new log
I20260811 07:37:52.863250 21481 ts_tablet_manager.cc:1397] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s
I20260811 07:37:52.863850 21480 tablet_bootstrap.cc:492] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: No bootstrap required, opened a new log
I20260811 07:37:52.864151 21480 ts_tablet_manager.cc:1397] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260811 07:37:52.867432 21479 raft_consensus.cc:348] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:52.867928 21479 raft_consensus.cc:374] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:52.867868 21480 raft_consensus.cc:348] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:52.868212 21479 raft_consensus.cc:729] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf686a39418465884cf9e0eec1c0b42, State: Initialized, Role: FOLLOWER
I20260811 07:37:52.868295 21480 raft_consensus.cc:374] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:52.868371 21480 raft_consensus.cc:729] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0991c75b167e40ce94120b7cc1b17cd3, State: Initialized, Role: FOLLOWER
I20260811 07:37:52.868938 21479 consensus_queue.cc:260] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:52.869177 21480 consensus_queue.cc:260] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:52.868609 21481 raft_consensus.cc:348] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:52.869561 21481 raft_consensus.cc:374] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:52.869645 21481 raft_consensus.cc:729] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a87e3a55ef834f0c9718979bb1af32f0, State: Initialized, Role: FOLLOWER
I20260811 07:37:52.870276 21481 consensus_queue.cc:260] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:52.870625 21479 ts_tablet_manager.cc:1428] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260811 07:37:52.870726 21480 ts_tablet_manager.cc:1428] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260811 07:37:52.871124 21057 heartbeater.cc:503] Master 127.22.4.254:46579 was elected leader, sending a full tablet report...
I20260811 07:37:52.871251 21263 heartbeater.cc:503] Master 127.22.4.254:46579 was elected leader, sending a full tablet report...
I20260811 07:37:52.871603 21481 ts_tablet_manager.cc:1428] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260811 07:37:52.872736 21451 heartbeater.cc:503] Master 127.22.4.254:46579 was elected leader, sending a full tablet report...
W20260811 07:37:53.003417 21058 tablet.cc:2369] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:37:53.016573 21264 tablet.cc:2369] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 07:37:53.029783 21452 tablet.cc:2369] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:37:53.122942 21487 raft_consensus.cc:482] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 07:37:53.123558 21487 raft_consensus.cc:504] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:53.125878 21487 leader_election.cc:288] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0991c75b167e40ce94120b7cc1b17cd3 (127.22.4.194:35707), a87e3a55ef834f0c9718979bb1af32f0 (127.22.4.195:33245)
I20260811 07:37:53.131907 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:53.126987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:36685 (local address 127.22.4.195:33245)
0811 07:37:53.127147 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:53.127154 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:53.127400 (+ 246us) server_negotiation.cc:407] Connection header received
0811 07:37:53.127538 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:53.127541 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:53.127597 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:53.127711 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:53.128133 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.128756 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.130383 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.131039 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.131174 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:53.131216 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:53.131621 (+ 405us) server_negotiation.cc:299] Negotiation successful
0811 07:37:53.131726 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260811 07:37:53.131907 21477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:53.126575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.22.4.193:58423 (local address 127.22.4.194:35707)
0811 07:37:53.126858 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:53.126864 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:53.126887 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:37:53.127070 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:53.127075 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:53.127151 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:53.127248 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 07:37:53.127797 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.128491 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.130158 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.130891 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.131051 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:53.131136 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:53.131645 (+ 509us) server_negotiation.cc:299] Negotiation successful
0811 07:37:53.131740 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260811 07:37:53.131956 21493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:53.126691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.195:33245 (local address 127.22.4.193:36685)
0811 07:37:53.127280 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:53.127297 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:53.127416 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:53.127795 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:53.127798 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:53.127818 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:53.127969 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:53.127975 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.128967 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.128970 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:53.130208 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:53.130222 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.131272 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.131285 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:53.131410 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:53.131430 (+ 20us) client_negotiation.cc:769] Sending connection context
0811 07:37:53.131580 (+ 150us) client_negotiation.cc:240] Negotiation successful
0811 07:37:53.131640 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"mutex_wait_us":7,"thread_start_us":210,"threads_started":1}
I20260811 07:37:53.131974 21491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:53.126241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.194:35707 (local address 127.22.4.193:58423)
0811 07:37:53.126685 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:53.126707 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0811 07:37:53.126913 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:37:53.127313 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:37:53.127317 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:37:53.127375 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 07:37:53.127589 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:53.127599 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.128646 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.128650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:53.129961 (+ 1311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:37:53.129978 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.131063 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.131067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:37:53.131326 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:53.131402 (+ 76us) client_negotiation.cc:769] Sending connection context
0811 07:37:53.131519 (+ 117us) client_negotiation.cc:240] Negotiation successful
0811 07:37:53.131640 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":31,"thread_start_us":203,"threads_started":1}
I20260811 07:37:53.133169 21386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6729d722034400890aadcd5aa608296" candidate_uuid: "bdf686a39418465884cf9e0eec1c0b42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87e3a55ef834f0c9718979bb1af32f0" is_pre_election: true
I20260811 07:37:53.133284 21198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6729d722034400890aadcd5aa608296" candidate_uuid: "bdf686a39418465884cf9e0eec1c0b42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0991c75b167e40ce94120b7cc1b17cd3" is_pre_election: true
I20260811 07:37:53.133694 21386 raft_consensus.cc:2454] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf686a39418465884cf9e0eec1c0b42 in term 0.
I20260811 07:37:53.133761 21198 raft_consensus.cc:2454] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bdf686a39418465884cf9e0eec1c0b42 in term 0.
I20260811 07:37:53.134498 20880 leader_election.cc:302] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a87e3a55ef834f0c9718979bb1af32f0, bdf686a39418465884cf9e0eec1c0b42; no voters:
I20260811 07:37:53.135017 21487 raft_consensus.cc:2781] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 07:37:53.135141 21487 raft_consensus.cc:482] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 07:37:53.135192 21487 raft_consensus.cc:3037] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:53.136670 21487 raft_consensus.cc:504] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:53.137171 21487 leader_election.cc:288] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [CANDIDATE]: Term 1 election: Requested vote from peers 0991c75b167e40ce94120b7cc1b17cd3 (127.22.4.194:35707), a87e3a55ef834f0c9718979bb1af32f0 (127.22.4.195:33245)
I20260811 07:37:53.137840 21386 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6729d722034400890aadcd5aa608296" candidate_uuid: "bdf686a39418465884cf9e0eec1c0b42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a87e3a55ef834f0c9718979bb1af32f0"
I20260811 07:37:53.137899 21198 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6729d722034400890aadcd5aa608296" candidate_uuid: "bdf686a39418465884cf9e0eec1c0b42" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0991c75b167e40ce94120b7cc1b17cd3"
I20260811 07:37:53.138090 21386 raft_consensus.cc:3037] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:53.138113 21198 raft_consensus.cc:3037] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:53.139671 21386 raft_consensus.cc:2454] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf686a39418465884cf9e0eec1c0b42 in term 1.
I20260811 07:37:53.139693 21198 raft_consensus.cc:2454] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bdf686a39418465884cf9e0eec1c0b42 in term 1.
I20260811 07:37:53.140184 20880 leader_election.cc:302] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a87e3a55ef834f0c9718979bb1af32f0, bdf686a39418465884cf9e0eec1c0b42; no voters:
I20260811 07:37:53.140465 21487 raft_consensus.cc:2781] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:53.140823 21487 raft_consensus.cc:686] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [term 1 LEADER]: Becoming Leader. State: Replica: bdf686a39418465884cf9e0eec1c0b42, State: Running, Role: LEADER
I20260811 07:37:53.141264 21487 consensus_queue.cc:237] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } }
I20260811 07:37:53.145576 20755 catalog_manager.cc:5495] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 reported cstate change: term changed from 0 to 1, leader changed from <none> to bdf686a39418465884cf9e0eec1c0b42 (127.22.4.193). New cstate: current_term: 1 leader_uuid: "bdf686a39418465884cf9e0eec1c0b42" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bdf686a39418465884cf9e0eec1c0b42" member_type: VOTER last_known_addr { host: "127.22.4.193" port: 45479 } health_report { overall_health: HEALTHY } } }
I20260811 07:37:53.215227 21474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:53.210065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58022 (local address 127.22.4.193:45479)
0811 07:37:53.210274 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:53.210280 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:53.210302 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:37:53.210441 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:53.210444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:53.210510 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:53.210639 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:37:53.211055 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.211842 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.212953 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:53.213217 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:53.213321 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:53.213817 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:37:53.214550 (+ 733us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:37:53.214731 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:53.214945 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 07:37:53.215054 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260811 07:37:53.224162 21386 raft_consensus.cc:1261] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 1 FOLLOWER]: Refusing update from remote peer bdf686a39418465884cf9e0eec1c0b42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:53.224354 21198 raft_consensus.cc:1261] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 1 FOLLOWER]: Refusing update from remote peer bdf686a39418465884cf9e0eec1c0b42: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:37:53.225234 21494 consensus_queue.cc:1035] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a87e3a55ef834f0c9718979bb1af32f0" member_type: VOTER last_known_addr { host: "127.22.4.195" port: 33245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:53.225543 21487 consensus_queue.cc:1035] T f6729d722034400890aadcd5aa608296 P bdf686a39418465884cf9e0eec1c0b42 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0991c75b167e40ce94120b7cc1b17cd3" member_type: VOTER last_known_addr { host: "127.22.4.194" port: 35707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:37:53.238408 21499 mvcc.cc:205] Tried to move back new op lower bound from 7317233144714616832 to 7317233144389824512. Current Snapshot: MvccSnapshot[applied={T|T < 7317233144714616832}]
I20260811 07:37:53.239181 21498 mvcc.cc:205] Tried to move back new op lower bound from 7317233144714616832 to 7317233144389824512. Current Snapshot: MvccSnapshot[applied={T|T < 7317233144714616832}]
I20260811 07:37:53.250375 20753 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:53.250624 20753 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 07:37:53.254323 20753 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 176e2bc6ce2344a58b1706fa3cc41b5b: Sending DeleteTablet for 3 replicas of tablet f6729d722034400890aadcd5aa608296
I20260811 07:37:53.255797 21161 tablet_service.cc:1514] Processing DeleteTablet for tablet f6729d722034400890aadcd5aa608296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:53 UTC) from {username='slave'} at 127.0.0.1:56718
I20260811 07:37:53.255861 21352 tablet_service.cc:1514] Processing DeleteTablet for tablet f6729d722034400890aadcd5aa608296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:53 UTC) from {username='slave'} at 127.0.0.1:35126
I20260811 07:37:53.257237 20952 tablet_service.cc:1514] Processing DeleteTablet for tablet f6729d722034400890aadcd5aa608296 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 07:37:53 UTC) from {username='slave'} at 127.0.0.1:58014
I20260811 07:37:53.257892 21514 tablet_replica.cc:330] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: stopping tablet replica
I20260811 07:37:53.258093 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 20856
I20260811 07:37:53.266328 21516 tablet_replica.cc:330] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: stopping tablet replica
I20260811 07:37:53.266973 21516 raft_consensus.cc:2229] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:53.266940 21514 raft_consensus.cc:2229] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 07:37:53.267503 21516 raft_consensus.cc:2258] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:53.267588 21514 raft_consensus.cc:2258] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 07:37:53.271178 21516 ts_tablet_manager.cc:1905] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:53.271178 21514 ts_tablet_manager.cc:1905] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 07:37:53.275117 21516 ts_tablet_manager.cc:1918] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:53.275117 21514 ts_tablet_manager.cc:1918] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 07:37:53.275272 21514 log.cc:1196] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-1/wal/wals/f6729d722034400890aadcd5aa608296
I20260811 07:37:53.275282 21516 log.cc:1196] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Deleting WAL directory at /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786433529403386-22547-0/minicluster-data/ts-2/wal/wals/f6729d722034400890aadcd5aa608296
I20260811 07:37:53.275650 21514 ts_tablet_manager.cc:1939] T f6729d722034400890aadcd5aa608296 P 0991c75b167e40ce94120b7cc1b17cd3: Deleting consensus metadata
I20260811 07:37:53.275650 21516 ts_tablet_manager.cc:1939] T f6729d722034400890aadcd5aa608296 P a87e3a55ef834f0c9718979bb1af32f0: Deleting consensus metadata
I20260811 07:37:53.277650 20731 catalog_manager.cc:4841] TS 0991c75b167e40ce94120b7cc1b17cd3 (127.22.4.194:35707): tablet f6729d722034400890aadcd5aa608296 (table test-table [id=8fbb3bfc58144db8856547625080301e]) successfully deleted
I20260811 07:37:53.277650 20730 catalog_manager.cc:4841] TS a87e3a55ef834f0c9718979bb1af32f0 (127.22.4.195:33245): tablet f6729d722034400890aadcd5aa608296 (table test-table [id=8fbb3bfc58144db8856547625080301e]) successfully deleted
W20260811 07:37:53.280592 20729 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.22.4.193:45479 (error 108)
I20260811 07:37:53.280810 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 21060
I20260811 07:37:53.299186 21472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:53.298508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.193:45479 (local address 127.0.0.1:58024)
0811 07:37:53.298904 (+ 396us) negotiation.cc:107] Waiting for socket to connect
0811 07:37:53.299023 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.193:45479: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190}
W20260811 07:37:53.299479 20729 catalog_manager.cc:4584] TS bdf686a39418465884cf9e0eec1c0b42 (127.22.4.193:45479): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f6729d722034400890aadcd5aa608296: Network error: Client connection negotiation failed: client connection to 127.22.4.193:45479: connect: Connection refused (error 111)
I20260811 07:37:53.318058 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 21266
I20260811 07:37:53.343125 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 20708
2026-08-11T07:37:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1704 ms)
[----------] 6 tests from EncryptionPolicyTest (16053 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:37:53 dist-test-slave-7z32 krb5kdc[21526](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:37:53 dist-test-slave-7z32 krb5kdc[21526](info): set up 2 sockets
Aug 11 07:37:53 dist-test-slave-7z32 krb5kdc[21526](info): commencing operation
krb5kdc: starting...
W20260811 07:37:54.754691 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.379s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:37:54 dist-test-slave-7z32 krb5kdc[21526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:37:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:37:54.931136 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45633
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45633
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:55.067502 21543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:55.067854 21543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:55.067902 21543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:55.072475 21543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:55.072572 21543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:55.072593 21543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:55.072610 21543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:55.072626 21543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:55.078536 21543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45633
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:55.080204 21543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:55.081709 21543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:55.093251 21553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:55.093242 21548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:55.093242 21549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:55.093999 21543 server_base.cc:1034] running on GCE node
I20260811 07:37:55.094693 21543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:55.096118 21543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:55.097518 21543 hybrid_clock.cc:648] HybridClock initialized: now 1786433875097450 us; error 92 us; skew 500 ppm
Aug 11 07:37:55 dist-test-slave-7z32 krb5kdc[21526](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433875, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:55.107264 21543 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:37:55.108678 21543 webserver.cc:460] Webserver started at http://127.0.0.1:38157/ using document root <none> and password file <none>
I20260811 07:37:55.109366 21543 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:55.109473 21543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:55.109738 21543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:55.112283 21543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "1f626aaecaa2498d8eac0bda89d45219"
format_stamp: "Formatted at 2026-08-11 07:37:55 on dist-test-slave-7z32"
server_key: "3a5c6b8e559ed795d87e74a1f82eff72"
server_key_iv: "869396c53102529c9ad258bb146a6b1d"
server_key_version: "encryptionkey@0"
I20260811 07:37:55.112977 21543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "1f626aaecaa2498d8eac0bda89d45219"
format_stamp: "Formatted at 2026-08-11 07:37:55 on dist-test-slave-7z32"
server_key: "3a5c6b8e559ed795d87e74a1f82eff72"
server_key_iv: "869396c53102529c9ad258bb146a6b1d"
server_key_version: "encryptionkey@0"
I20260811 07:37:55.117818 21543 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:37:55.121471 21566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:55.123448 21543 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260811 07:37:55.123651 21543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "1f626aaecaa2498d8eac0bda89d45219"
format_stamp: "Formatted at 2026-08-11 07:37:55 on dist-test-slave-7z32"
server_key: "3a5c6b8e559ed795d87e74a1f82eff72"
server_key_iv: "869396c53102529c9ad258bb146a6b1d"
server_key_version: "encryptionkey@0"
I20260811 07:37:55.123809 21543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:55.142421 21543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:55.146461 21543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:55.146715 21543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:55.155759 21543 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45633
I20260811 07:37:55.155856 21648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45633 every 8 connection(s)
I20260811 07:37:55.156975 21543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:55.161170 21649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:55.161552 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 21543
I20260811 07:37:55.161741 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:55.162160 22547 external_mini_cluster.cc:1428] Setting key 107641a47fb4fdbff2545e8bd204d558
I20260811 07:37:55.169680 21649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219: Bootstrap starting.
I20260811 07:37:55.173785 21649 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219: Neither blocks nor log segments found. Creating new log.
Aug 11 07:37:55 dist-test-slave-7z32 krb5kdc[21526](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:37:55.174911 21649 log.cc:824] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:55.177644 21649 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219: No bootstrap required, opened a new log
I20260811 07:37:55.182462 21652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:55.164213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46793 (local address 127.0.0.1:45633)
0811 07:37:55.164858 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:55.164878 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:55.164927 (+ 49us) server_negotiation.cc:407] Connection header received
0811 07:37:55.165863 (+ 936us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:55.165884 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:55.166370 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:55.166752 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:55.167953 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:55.169148 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:55.170696 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:55.171392 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:55.171556 (+ 164us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:55.175667 (+ 4111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:55.175674 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:55.175696 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:55.175742 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:55.178102 (+ 2360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:55.179061 (+ 959us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:55.179070 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:55.179078 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:55.179257 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:55.179868 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:55.179878 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:55.179880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:55.180426 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:55.180875 (+ 449us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:55.181182 (+ 307us) server_negotiation.cc:299] Negotiation successful
0811 07:37:55.181480 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":214,"threads_started":1}
I20260811 07:37:55.182518 21649 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f626aaecaa2498d8eac0bda89d45219" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45633 } }
I20260811 07:37:55.183030 21649 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:55.183140 21649 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f626aaecaa2498d8eac0bda89d45219, State: Initialized, Role: FOLLOWER
I20260811 07:37:55.183782 21649 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f626aaecaa2498d8eac0bda89d45219" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45633 } }
I20260811 07:37:55.183977 21649 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:55.184072 21649 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:55.184181 21649 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:55.185776 21649 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f626aaecaa2498d8eac0bda89d45219" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45633 } }
I20260811 07:37:55.186307 21649 leader_election.cc:302] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f626aaecaa2498d8eac0bda89d45219; no voters:
I20260811 07:37:55.186801 21649 leader_election.cc:288] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:55.187009 21654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:55.187088 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:37:55.187404 21654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [term 1 LEADER]: Becoming Leader. State: Replica: 1f626aaecaa2498d8eac0bda89d45219, State: Running, Role: LEADER
I20260811 07:37:55.187876 21654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f626aaecaa2498d8eac0bda89d45219" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45633 } }
I20260811 07:37:55.188656 21649 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:55.189666 21654 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f626aaecaa2498d8eac0bda89d45219. Latest consensus state: current_term: 1 leader_uuid: "1f626aaecaa2498d8eac0bda89d45219" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f626aaecaa2498d8eac0bda89d45219" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45633 } } }
I20260811 07:37:55.189855 21654 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:55.190237 21655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f626aaecaa2498d8eac0bda89d45219" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f626aaecaa2498d8eac0bda89d45219" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45633 } } }
I20260811 07:37:55.190374 21655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219 [sys.catalog]: This master's current role is: LEADER
W20260811 07:37:55.195437 21681 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:37:55.195570 21681 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:37:55.195693 21671 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:55.196805 21671 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:55.202278 21652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:55.190471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52179 (local address 127.0.0.1:45633)
0811 07:37:55.190611 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:55.190618 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:55.191220 (+ 602us) server_negotiation.cc:407] Connection header received
0811 07:37:55.191456 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:55.191460 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:55.191525 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:55.191618 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:55.192637 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:55.193469 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:55.194758 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:55.195207 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:55.195382 (+ 175us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:55.197705 (+ 2323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:55.197709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:55.197713 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:37:55.197751 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:55.199955 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:55.200676 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:55.200685 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:55.200687 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:55.200781 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:37:55.201179 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:37:55.201183 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:37:55.201185 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:37:55.201417 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:55.201609 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:55.201906 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 07:37:55.202056 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 07:37:55.205443 21671 catalog_manager.cc:1347] Generated new cluster ID: f41409a832c842dea50bacbe7292c738
I20260811 07:37:55.205588 21671 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:55.223366 21671 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:55.224920 21671 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:55.233204 21671 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f626aaecaa2498d8eac0bda89d45219: Generated new TSK 0
I20260811 07:37:55.234365 21671 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:37:55.246047 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 21543
W20260811 07:37:55.267454 21522 connection.cc:535] client connection to 127.0.0.1:45633 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45633): Connection reset by peer (error 104)
2026-08-11T07:37:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1908 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:37:55 dist-test-slave-7z32 krb5kdc[21687](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:37:55 dist-test-slave-7z32 krb5kdc[21687](info): set up 2 sockets
Aug 11 07:37:55 dist-test-slave-7z32 krb5kdc[21687](info): commencing operation
krb5kdc: starting...
W20260811 07:37:56.647146 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.363s user 0.000s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:37:56 dist-test-slave-7z32 krb5kdc[21687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:37:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:37:56.849395 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38127
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:56.985162 21707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:56.985522 21707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:56.985569 21707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:56.989984 21707 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:56.990115 21707 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:56.990147 21707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:56.990166 21707 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:56.990182 21707 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:56.996260 21707 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38127
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21707
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:56.997567 21707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:56.998775 21707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:57.009685 21714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:57.009760 21717 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:57.009685 21713 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:57.010211 21707 server_base.cc:1034] running on GCE node
I20260811 07:37:57.011255 21707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:57.013068 21707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:57.016455 21707 hybrid_clock.cc:648] HybridClock initialized: now 1786433877016322 us; error 146 us; skew 500 ppm
Aug 11 07:37:57 dist-test-slave-7z32 krb5kdc[21687](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433877, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:57.021087 21707 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:37:57.022650 21707 webserver.cc:460] Webserver started at http://127.0.0.1:45587/ using document root <none> and password file <none>
I20260811 07:37:57.023598 21707 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:57.023728 21707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:57.024061 21707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:57.027328 21707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "fdee06f3320a4958ba74edf4e412a986"
format_stamp: "Formatted at 2026-08-11 07:37:57 on dist-test-slave-7z32"
server_key: "cccd2b5c250e57fa05e38078e3037988"
server_key_iv: "3468aef3f43c50a67a1267e4de99c336"
server_key_version: "encryptionkey@0"
I20260811 07:37:57.028198 21707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "fdee06f3320a4958ba74edf4e412a986"
format_stamp: "Formatted at 2026-08-11 07:37:57 on dist-test-slave-7z32"
server_key: "cccd2b5c250e57fa05e38078e3037988"
server_key_iv: "3468aef3f43c50a67a1267e4de99c336"
server_key_version: "encryptionkey@0"
I20260811 07:37:57.034329 21707 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:37:57.039183 21725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:57.041390 21707 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.003s
I20260811 07:37:57.041819 21707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "fdee06f3320a4958ba74edf4e412a986"
format_stamp: "Formatted at 2026-08-11 07:37:57 on dist-test-slave-7z32"
server_key: "cccd2b5c250e57fa05e38078e3037988"
server_key_iv: "3468aef3f43c50a67a1267e4de99c336"
server_key_version: "encryptionkey@0"
I20260811 07:37:57.042079 21707 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:57.070748 21707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:57.076015 21707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:57.076344 21707 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:57.088413 21707 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38127
I20260811 07:37:57.088443 21806 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38127 every 8 connection(s)
I20260811 07:37:57.089879 21707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:57.092607 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 21707
I20260811 07:37:57.092806 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:57.093171 22547 external_mini_cluster.cc:1428] Setting key e6e701760f247dd02fc9aa52c92953a2
I20260811 07:37:57.094070 21807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:57.102641 21807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986: Bootstrap starting.
I20260811 07:37:57.105378 21807 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:57.106465 21807 log.cc:824] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:57.107111 21810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:57.095248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53495 (local address 127.0.0.1:38127)
0811 07:37:57.095971 (+ 723us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:57.095995 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:57.096096 (+ 101us) server_negotiation.cc:407] Connection header received
0811 07:37:57.097595 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:57.097628 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:57.098175 (+ 547us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:57.098813 (+ 638us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:57.099425 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:57.100941 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:57.102062 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:57.102694 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:57.102941 (+ 247us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:57.104439 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:57.104445 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:57.104468 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:57.105076 (+ 608us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:57.105179 (+ 103us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:57.105212 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:57.105398 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:57.105646 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 07:37:57.105859 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":493,"thread_start_us":228,"threads_started":1}
I20260811 07:37:57.110031 21807 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986: No bootstrap required, opened a new log
I20260811 07:37:57.112134 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:37:57.115624 21807 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee06f3320a4958ba74edf4e412a986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38127 } }
I20260811 07:37:57.116022 21807 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:57.116094 21807 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdee06f3320a4958ba74edf4e412a986, State: Initialized, Role: FOLLOWER
I20260811 07:37:57.116612 21807 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee06f3320a4958ba74edf4e412a986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38127 } }
I20260811 07:37:57.116791 21807 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:57.116864 21807 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:57.116974 21807 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:57.118059 21807 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee06f3320a4958ba74edf4e412a986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38127 } }
I20260811 07:37:57.118474 21807 leader_election.cc:302] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdee06f3320a4958ba74edf4e412a986; no voters:
I20260811 07:37:57.118908 21807 leader_election.cc:288] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:57.119007 21820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:57.119217 21820 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [term 1 LEADER]: Becoming Leader. State: Replica: fdee06f3320a4958ba74edf4e412a986, State: Running, Role: LEADER
I20260811 07:37:57.119544 21820 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee06f3320a4958ba74edf4e412a986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38127 } }
I20260811 07:37:57.120805 21807 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:57.120898 21822 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdee06f3320a4958ba74edf4e412a986" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee06f3320a4958ba74edf4e412a986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38127 } } }
I20260811 07:37:57.121021 21822 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:57.121434 21810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:57.115299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50775 (local address 127.0.0.1:38127)
0811 07:37:57.115514 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:57.115520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:57.115792 (+ 272us) server_negotiation.cc:407] Connection header received
0811 07:37:57.115970 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:57.115973 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:57.116127 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:57.116295 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:57.116732 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:57.117517 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:57.118499 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:37:57.118931 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:37:57.119094 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:37:57.120539 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:57.120543 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:57.120545 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:57.120562 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:57.120622 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:57.120635 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:57.120759 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:57.121184 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 07:37:57.121248 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260811 07:37:57.121449 21826 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:57.123805 21821 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdee06f3320a4958ba74edf4e412a986. Latest consensus state: current_term: 1 leader_uuid: "fdee06f3320a4958ba74edf4e412a986" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee06f3320a4958ba74edf4e412a986" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38127 } } }
I20260811 07:37:57.123998 21821 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986 [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:57.127667 21826 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:57.137267 21826 catalog_manager.cc:1347] Generated new cluster ID: 528483a93273407b9a67c7dda93e981e
I20260811 07:37:57.137396 21826 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:57.148216 21826 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:57.149950 21826 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:57.156491 21826 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdee06f3320a4958ba74edf4e412a986: Generated new TSK 0
I20260811 07:37:57.158023 21826 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:37:57.167658 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 21707
W20260811 07:37:57.194531 21685 connection.cc:535] client connection to 127.0.0.1:38127 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38127): Connection reset by peer (error 104)
2026-08-11T07:37:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1926 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:37:57 dist-test-slave-7z32 krb5kdc[21856](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:37:57 dist-test-slave-7z32 krb5kdc[21856](info): set up 2 sockets
Aug 11 07:37:57 dist-test-slave-7z32 krb5kdc[21856](info): commencing operation
krb5kdc: starting...
W20260811 07:37:58.592664 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.382s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:37:58 dist-test-slave-7z32 krb5kdc[21856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:37:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:37:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:37:58.801026 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43233
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39767
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:37:58.975821 21877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:37:58.976402 21877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:37:58.976547 21877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:37:58.981778 21877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:37:58.981952 21877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:37:58.982337 21877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:37:58.982410 21877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:37:58.982447 21877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:37:58.993068 21877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39767
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43233
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:37:58.995101 21877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:37:58.997352 21877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:37:59.011920 21892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:59.011920 21884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:37:59.012526 21887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:37:59.013132 21877 server_base.cc:1034] running on GCE node
I20260811 07:37:59.014153 21877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:37:59.016153 21877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:37:59.019737 21877 hybrid_clock.cc:648] HybridClock initialized: now 1786433879019635 us; error 92 us; skew 500 ppm
Aug 11 07:37:59 dist-test-slave-7z32 krb5kdc[21856](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433879, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:37:59.025946 21877 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:37:59.027711 21877 webserver.cc:460] Webserver started at http://127.0.0.1:36601/ using document root <none> and password file <none>
I20260811 07:37:59.029394 21877 fs_manager.cc:359] Metadata directory not provided
I20260811 07:37:59.029552 21877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:37:59.029865 21877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:37:59.033569 21877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "d42c38d01ec14f52ad0500f47797869d"
format_stamp: "Formatted at 2026-08-11 07:37:59 on dist-test-slave-7z32"
server_key: "15f996427b7b5c2d4fdeffd0a04b8101"
server_key_iv: "f9122ea3847acbdb1503d86d6e8f1548"
server_key_version: "encryptionkey@0"
I20260811 07:37:59.034444 21877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "d42c38d01ec14f52ad0500f47797869d"
format_stamp: "Formatted at 2026-08-11 07:37:59 on dist-test-slave-7z32"
server_key: "15f996427b7b5c2d4fdeffd0a04b8101"
server_key_iv: "f9122ea3847acbdb1503d86d6e8f1548"
server_key_version: "encryptionkey@0"
I20260811 07:37:59.040577 21877 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:37:59.046245 21905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:37:59.048830 21877 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.002s sys 0.000s
I20260811 07:37:59.049044 21877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "d42c38d01ec14f52ad0500f47797869d"
format_stamp: "Formatted at 2026-08-11 07:37:59 on dist-test-slave-7z32"
server_key: "15f996427b7b5c2d4fdeffd0a04b8101"
server_key_iv: "f9122ea3847acbdb1503d86d6e8f1548"
server_key_version: "encryptionkey@0"
I20260811 07:37:59.049192 21877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:37:59.056001 21877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:37:59.061271 21877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:37:59.061654 21877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:37:59.078908 21877 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43233
I20260811 07:37:59.079321 21992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43233 every 8 connection(s)
I20260811 07:37:59.080607 21877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:37:59.085788 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 21877
I20260811 07:37:59.086176 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:37:59.086372 21993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:37:59.086764 22547 external_mini_cluster.cc:1428] Setting key 3fd3bc685151760765f4d5fa8a61ab2b
I20260811 07:37:59.096294 21998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:59.089547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59233 (local address 127.0.0.1:43233)
0811 07:37:59.090713 (+ 1166us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:59.090738 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:59.090795 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:37:59.092183 (+ 1388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:59.092210 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:59.092631 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:59.093142 (+ 511us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:59.094492 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:59.094498 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:59.094516 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:59.094535 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:59.094608 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:59.094634 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:59.094872 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:59.094963 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 07:37:59.095173 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":902,"thread_start_us":474,"threads_started":1}
I20260811 07:37:59.098577 21993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d: Bootstrap starting.
I20260811 07:37:59.101994 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:37:59.102785 21993 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d: Neither blocks nor log segments found. Creating new log.
I20260811 07:37:59.104128 21993 log.cc:824] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:37:59.107583 21993 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d: No bootstrap required, opened a new log
I20260811 07:37:59.107939 21998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:37:59.105466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41229 (local address 127.0.0.1:43233)
0811 07:37:59.105721 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0811 07:37:59.105729 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:37:59.105875 (+ 146us) server_negotiation.cc:407] Connection header received
0811 07:37:59.106105 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:37:59.106110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:37:59.106172 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:37:59.106304 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:37:59.107345 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:37:59.107350 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:37:59.107353 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:37:59.107367 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:37:59.107411 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:37:59.107424 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:37:59.107548 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:37:59.107688 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 07:37:59.107748 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260811 07:37:59.112442 21993 raft_consensus.cc:348] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42c38d01ec14f52ad0500f47797869d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43233 } }
I20260811 07:37:59.112818 21993 raft_consensus.cc:374] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:37:59.112895 21993 raft_consensus.cc:729] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d42c38d01ec14f52ad0500f47797869d, State: Initialized, Role: FOLLOWER
I20260811 07:37:59.113418 21993 consensus_queue.cc:260] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42c38d01ec14f52ad0500f47797869d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43233 } }
I20260811 07:37:59.113605 21993 raft_consensus.cc:388] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:37:59.113703 21993 raft_consensus.cc:482] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:37:59.113844 21993 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:37:59.115264 21993 raft_consensus.cc:504] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42c38d01ec14f52ad0500f47797869d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43233 } }
I20260811 07:37:59.115722 21993 leader_election.cc:302] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d42c38d01ec14f52ad0500f47797869d; no voters:
I20260811 07:37:59.116144 21993 leader_election.cc:288] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:37:59.116487 22009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:37:59.117127 22009 raft_consensus.cc:686] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [term 1 LEADER]: Becoming Leader. State: Replica: d42c38d01ec14f52ad0500f47797869d, State: Running, Role: LEADER
I20260811 07:37:59.117714 21993 sys_catalog.cc:564] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:37:59.117770 22009 consensus_queue.cc:237] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42c38d01ec14f52ad0500f47797869d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43233 } }
I20260811 07:37:59.120697 22011 sys_catalog.cc:455] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d42c38d01ec14f52ad0500f47797869d. Latest consensus state: current_term: 1 leader_uuid: "d42c38d01ec14f52ad0500f47797869d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42c38d01ec14f52ad0500f47797869d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43233 } } }
I20260811 07:37:59.120929 22011 sys_catalog.cc:458] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [sys.catalog]: This master's current role is: LEADER
I20260811 07:37:59.121289 22010 sys_catalog.cc:455] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d42c38d01ec14f52ad0500f47797869d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d42c38d01ec14f52ad0500f47797869d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43233 } } }
I20260811 07:37:59.121429 22010 sys_catalog.cc:458] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d [sys.catalog]: This master's current role is: LEADER
W20260811 07:37:59.124946 22025 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:37:59.125088 22025 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:37:59.125206 22027 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:37:59.126467 22027 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:37:59.136940 22027 catalog_manager.cc:1347] Generated new cluster ID: dd5b1d1c1af2404b9c8e6fe45002e888
I20260811 07:37:59.137091 22027 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:37:59.151422 22027 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:37:59.152010 22027 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:37:59.165271 22027 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d42c38d01ec14f52ad0500f47797869d: Generated new TSK 0
I20260811 07:37:59.166597 22027 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:37:59.172122 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 21877
2026-08-11T07:37:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1991 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:37:59 dist-test-slave-7z32 krb5kdc[22036](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:37:59 dist-test-slave-7z32 krb5kdc[22036](info): set up 2 sockets
Aug 11 07:37:59 dist-test-slave-7z32 krb5kdc[22036](info): commencing operation
krb5kdc: starting...
W20260811 07:38:00.689836 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.487s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:00 dist-test-slave-7z32 krb5kdc[22036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:00.880084 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33247
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:01.050511 22056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:01.051138 22056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:01.051254 22056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:01.056563 22056 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:01.056766 22056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:01.056823 22056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:01.056867 22056 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:01.056906 22056 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:01.064033 22056 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:01.065900 22056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:01.067427 22056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:01.079607 22074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:01.079850 22067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:01.079607 22066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:01.079980 22056 server_base.cc:1034] running on GCE node
I20260811 07:38:01.081141 22056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:01.082660 22056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:01.083984 22056 hybrid_clock.cc:648] HybridClock initialized: now 1786433881083932 us; error 72 us; skew 500 ppm
Aug 11 07:38:01 dist-test-slave-7z32 krb5kdc[22036](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433881, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:01.092705 22056 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:01.094131 22056 webserver.cc:460] Webserver started at http://127.0.0.1:46631/ using document root <none> and password file <none>
I20260811 07:38:01.094992 22056 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:01.095113 22056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:01.095422 22056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:01.098070 22056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "022ccd788ae3469caea9552b87595f0d"
format_stamp: "Formatted at 2026-08-11 07:38:01 on dist-test-slave-7z32"
server_key: "ea12d715e1fac72d998d6a3fcce26662"
server_key_iv: "a0e939f775b0edb6afcd475521db9005"
server_key_version: "encryptionkey@0"
I20260811 07:38:01.098932 22056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "022ccd788ae3469caea9552b87595f0d"
format_stamp: "Formatted at 2026-08-11 07:38:01 on dist-test-slave-7z32"
server_key: "ea12d715e1fac72d998d6a3fcce26662"
server_key_iv: "a0e939f775b0edb6afcd475521db9005"
server_key_version: "encryptionkey@0"
I20260811 07:38:01.104281 22056 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:38:01.109284 22084 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:01.111459 22056 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:38:01.111703 22056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "022ccd788ae3469caea9552b87595f0d"
format_stamp: "Formatted at 2026-08-11 07:38:01 on dist-test-slave-7z32"
server_key: "ea12d715e1fac72d998d6a3fcce26662"
server_key_iv: "a0e939f775b0edb6afcd475521db9005"
server_key_version: "encryptionkey@0"
I20260811 07:38:01.111860 22056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:01.143262 22056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:01.147360 22056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:01.147634 22056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:01.156976 22056 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33247
I20260811 07:38:01.157059 22159 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33247 every 8 connection(s)
I20260811 07:38:01.158239 22056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:01.162479 22162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:01.163918 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22056
I20260811 07:38:01.164165 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:01.164690 22547 external_mini_cluster.cc:1428] Setting key c038fd3fcbd0ed07b3a74015e6c84c48
I20260811 07:38:01.172312 22162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d: Bootstrap starting.
I20260811 07:38:01.176088 22162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d: Neither blocks nor log segments found. Creating new log.
Aug 11 07:38:01 dist-test-slave-7z32 krb5kdc[22036](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433880, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:38:01.177366 22162 log.cc:824] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:01.180523 22162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d: No bootstrap required, opened a new log
I20260811 07:38:01.183991 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:01.167109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43531 (local address 127.0.0.1:33247)
0811 07:38:01.167827 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:01.167856 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:01.167911 (+ 55us) server_negotiation.cc:407] Connection header received
0811 07:38:01.168927 (+ 1016us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:01.168953 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:01.169436 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:01.169871 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:01.170880 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:01.172286 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:01.173462 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:01.174054 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:01.174270 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:01.178210 (+ 3940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:01.178218 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:01.178240 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:01.178295 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:01.180498 (+ 2203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:01.181079 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:01.181085 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:01.181092 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:01.181224 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:01.181544 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:01.181548 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:01.181551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:01.182064 (+ 513us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:01.182283 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:01.182713 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 07:38:01.183095 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":221,"threads_started":1}
I20260811 07:38:01.185407 22162 raft_consensus.cc:348] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "022ccd788ae3469caea9552b87595f0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33247 } }
I20260811 07:38:01.185781 22162 raft_consensus.cc:374] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:01.185873 22162 raft_consensus.cc:729] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 022ccd788ae3469caea9552b87595f0d, State: Initialized, Role: FOLLOWER
I20260811 07:38:01.186522 22162 consensus_queue.cc:260] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "022ccd788ae3469caea9552b87595f0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33247 } }
I20260811 07:38:01.186733 22162 raft_consensus.cc:388] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:01.186853 22162 raft_consensus.cc:482] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:01.187036 22162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:01.188218 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:01.188817 22162 raft_consensus.cc:504] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "022ccd788ae3469caea9552b87595f0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33247 } }
I20260811 07:38:01.189421 22162 leader_election.cc:302] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 022ccd788ae3469caea9552b87595f0d; no voters:
I20260811 07:38:01.190433 22162 leader_election.cc:288] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:01.190801 22171 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:01.191300 22171 raft_consensus.cc:686] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [term 1 LEADER]: Becoming Leader. State: Replica: 022ccd788ae3469caea9552b87595f0d, State: Running, Role: LEADER
I20260811 07:38:01.191869 22171 consensus_queue.cc:237] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "022ccd788ae3469caea9552b87595f0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33247 } }
I20260811 07:38:01.192778 22162 sys_catalog.cc:564] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:01.195489 22179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "022ccd788ae3469caea9552b87595f0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "022ccd788ae3469caea9552b87595f0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33247 } } }
I20260811 07:38:01.195713 22179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:01.195909 22178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 022ccd788ae3469caea9552b87595f0d. Latest consensus state: current_term: 1 leader_uuid: "022ccd788ae3469caea9552b87595f0d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "022ccd788ae3469caea9552b87595f0d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33247 } } }
I20260811 07:38:01.196465 22178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d [sys.catalog]: This master's current role is: LEADER
W20260811 07:38:01.200750 22201 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:01.200945 22201 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:01.201066 22202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:01.202469 22202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:01.206712 22169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:01.192277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40323 (local address 127.0.0.1:33247)
0811 07:38:01.192463 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:01.192469 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:01.192946 (+ 477us) server_negotiation.cc:407] Connection header received
0811 07:38:01.193347 (+ 401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:01.193353 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:01.193443 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:01.193596 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:01.194863 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:01.195839 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:01.197701 (+ 1862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:01.198100 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:01.198283 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:01.200499 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:01.200504 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:01.200509 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:01.200549 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:01.203001 (+ 2452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:01.204255 (+ 1254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:01.204259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:01.204261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:01.204386 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:01.205103 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:01.205107 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:01.205109 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:01.205409 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:01.205567 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:01.206126 (+ 559us) server_negotiation.cc:299] Negotiation successful
0811 07:38:01.206297 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:38:01.212708 22202 catalog_manager.cc:1347] Generated new cluster ID: 6e6f76356357467490f9aaeabd68fdb9
I20260811 07:38:01.212836 22202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:01.221871 22202 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:01.223817 22202 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:01.235157 22202 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 022ccd788ae3469caea9552b87595f0d: Generated new TSK 0
I20260811 07:38:01.237344 22202 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:01.249778 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22056
2026-08-11T07:38:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2099 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:01 dist-test-slave-7z32 krb5kdc[22213](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:01 dist-test-slave-7z32 krb5kdc[22213](info): set up 2 sockets
Aug 11 07:38:01 dist-test-slave-7z32 krb5kdc[22213](info): commencing operation
krb5kdc: starting...
W20260811 07:38:02.708971 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.407s user 0.000s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:02 dist-test-slave-7z32 krb5kdc[22213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:02.893467 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34347
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:03.034986 22232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:03.035338 22232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:03.035387 22232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:03.040036 22232 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:03.040148 22232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:03.040170 22232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:03.040189 22232 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:03.040212 22232 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:03.046743 22232 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34347
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:03.048146 22232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:03.049306 22232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:03.060529 22245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:03.060529 22240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:03.060563 22241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:03.061051 22232 server_base.cc:1034] running on GCE node
I20260811 07:38:03.061975 22232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:03.063799 22232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:03.065065 22232 hybrid_clock.cc:648] HybridClock initialized: now 1786433883064983 us; error 114 us; skew 500 ppm
Aug 11 07:38:03 dist-test-slave-7z32 krb5kdc[22213](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433883, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:03.068848 22232 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:03.070183 22232 webserver.cc:460] Webserver started at http://127.0.0.1:33423/ using document root <none> and password file <none>
I20260811 07:38:03.071084 22232 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:03.071195 22232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:03.071586 22232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:03.075240 22232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "037f1695da404ba4ab8eb5d7f7436775"
format_stamp: "Formatted at 2026-08-11 07:38:03 on dist-test-slave-7z32"
server_key: "d78644a87c2704c856cfc556072cdff6"
server_key_iv: "5145c8d89d7d10725f48ded74d85d6ee"
server_key_version: "encryptionkey@0"
I20260811 07:38:03.076125 22232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "037f1695da404ba4ab8eb5d7f7436775"
format_stamp: "Formatted at 2026-08-11 07:38:03 on dist-test-slave-7z32"
server_key: "d78644a87c2704c856cfc556072cdff6"
server_key_iv: "5145c8d89d7d10725f48ded74d85d6ee"
server_key_version: "encryptionkey@0"
I20260811 07:38:03.082144 22232 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:38:03.086539 22257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:03.088842 22232 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:38:03.089125 22232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "037f1695da404ba4ab8eb5d7f7436775"
format_stamp: "Formatted at 2026-08-11 07:38:03 on dist-test-slave-7z32"
server_key: "d78644a87c2704c856cfc556072cdff6"
server_key_iv: "5145c8d89d7d10725f48ded74d85d6ee"
server_key_version: "encryptionkey@0"
I20260811 07:38:03.089314 22232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:03.115444 22232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:03.120250 22232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:03.120587 22232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:03.131526 22232 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34347
I20260811 07:38:03.131557 22340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34347 every 8 connection(s)
I20260811 07:38:03.132975 22232 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:03.136672 22350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:03.136732 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22232
I20260811 07:38:03.137020 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:03.137495 22547 external_mini_cluster.cc:1428] Setting key fdac6e82560d2ee27ce5ef7c2d06f5dc
I20260811 07:38:03.144616 22350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775: Bootstrap starting.
I20260811 07:38:03.147960 22350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:03.149077 22350 log.cc:824] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:03.150287 22355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:03.139727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46997 (local address 127.0.0.1:34347)
0811 07:38:03.140409 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:03.140432 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:03.140505 (+ 73us) server_negotiation.cc:407] Connection header received
0811 07:38:03.141378 (+ 873us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:03.141406 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:03.141895 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:03.142313 (+ 418us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:03.142793 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:03.144366 (+ 1573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:03.145586 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:03.146333 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:03.146540 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:03.147909 (+ 1369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:03.147918 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:03.147941 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:03.148551 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:03.148640 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:03.148675 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:03.148816 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:03.149006 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 07:38:03.149285 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":194,"threads_started":1}
I20260811 07:38:03.152155 22350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775: No bootstrap required, opened a new log
I20260811 07:38:03.155309 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:03.158417 22350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "037f1695da404ba4ab8eb5d7f7436775" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34347 } }
I20260811 07:38:03.158833 22350 raft_consensus.cc:374] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:03.159451 22350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 037f1695da404ba4ab8eb5d7f7436775, State: Initialized, Role: FOLLOWER
I20260811 07:38:03.160132 22350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "037f1695da404ba4ab8eb5d7f7436775" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34347 } }
I20260811 07:38:03.160332 22350 raft_consensus.cc:388] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:03.160408 22350 raft_consensus.cc:482] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:03.160522 22350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:03.162010 22350 raft_consensus.cc:504] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "037f1695da404ba4ab8eb5d7f7436775" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34347 } }
I20260811 07:38:03.162504 22350 leader_election.cc:302] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 037f1695da404ba4ab8eb5d7f7436775; no voters:
I20260811 07:38:03.163049 22350 leader_election.cc:288] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:03.163635 22369 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:03.164049 22369 raft_consensus.cc:686] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [term 1 LEADER]: Becoming Leader. State: Replica: 037f1695da404ba4ab8eb5d7f7436775, State: Running, Role: LEADER
I20260811 07:38:03.164212 22355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:03.158372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44579 (local address 127.0.0.1:34347)
0811 07:38:03.158555 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:03.158561 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:03.158796 (+ 235us) server_negotiation.cc:407] Connection header received
0811 07:38:03.159071 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:03.159075 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:03.159140 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:03.159242 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:03.159682 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:03.160517 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:03.161990 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:03.162401 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:03.162524 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:03.163654 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:03.163659 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:03.163661 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:03.163679 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:03.163726 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:03.163743 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:03.163793 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:03.163975 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 07:38:03.164066 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:38:03.164579 22369 consensus_queue.cc:237] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "037f1695da404ba4ab8eb5d7f7436775" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34347 } }
I20260811 07:38:03.164840 22350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:03.167086 22371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 037f1695da404ba4ab8eb5d7f7436775. Latest consensus state: current_term: 1 leader_uuid: "037f1695da404ba4ab8eb5d7f7436775" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "037f1695da404ba4ab8eb5d7f7436775" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34347 } } }
I20260811 07:38:03.167295 22371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:03.167657 22370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "037f1695da404ba4ab8eb5d7f7436775" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "037f1695da404ba4ab8eb5d7f7436775" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34347 } } }
I20260811 07:38:03.168627 22370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775 [sys.catalog]: This master's current role is: LEADER
W20260811 07:38:03.171168 22392 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:03.171316 22392 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:03.171509 22394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:03.172856 22394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:03.181093 22394 catalog_manager.cc:1347] Generated new cluster ID: 33222c87f3874656963ea0ea191617d1
I20260811 07:38:03.181262 22394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:03.203737 22394 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:03.205204 22394 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:03.213522 22394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 037f1695da404ba4ab8eb5d7f7436775: Generated new TSK 0
I20260811 07:38:03.214741 22394 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:03.229071 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22232
2026-08-11T07:38:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1975 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:03 dist-test-slave-7z32 krb5kdc[22401](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:03 dist-test-slave-7z32 krb5kdc[22401](info): set up 2 sockets
Aug 11 07:38:03 dist-test-slave-7z32 krb5kdc[22401](info): commencing operation
krb5kdc: starting...
W20260811 07:38:04.688313 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.411s user 0.008s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:04 dist-test-slave-7z32 krb5kdc[22401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433884, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:04.892937 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41049
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41049
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:05.057963 22422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:05.058429 22422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:05.058483 22422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:05.064025 22422 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:05.064172 22422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:05.064195 22422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:05.064214 22422 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:05.064231 22422 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:05.071735 22422 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41049
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41049
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:05.073441 22422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:05.075196 22422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:05.088855 22435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:05.088941 22429 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:05.088871 22430 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:05.088977 22422 server_base.cc:1034] running on GCE node
I20260811 07:38:05.090211 22422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:05.091915 22422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:05.093444 22422 hybrid_clock.cc:648] HybridClock initialized: now 1786433885093314 us; error 81 us; skew 500 ppm
Aug 11 07:38:05 dist-test-slave-7z32 krb5kdc[22401](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433885, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:05.097970 22422 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:05.099884 22422 webserver.cc:460] Webserver started at http://127.0.0.1:46155/ using document root <none> and password file <none>
I20260811 07:38:05.100854 22422 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:05.100967 22422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:05.101234 22422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:05.104820 22422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "9b336b4bc32449a79c3a4c59060b4f96"
format_stamp: "Formatted at 2026-08-11 07:38:05 on dist-test-slave-7z32"
server_key: "29114edbf29d3718af75a4a909c9c6f9"
server_key_iv: "dd6d20652dd597896bb77835e6eef9e2"
server_key_version: "encryptionkey@0"
I20260811 07:38:05.105849 22422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "9b336b4bc32449a79c3a4c59060b4f96"
format_stamp: "Formatted at 2026-08-11 07:38:05 on dist-test-slave-7z32"
server_key: "29114edbf29d3718af75a4a909c9c6f9"
server_key_iv: "dd6d20652dd597896bb77835e6eef9e2"
server_key_version: "encryptionkey@0"
I20260811 07:38:05.112033 22422 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:38:05.116364 22445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:05.118463 22422 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:38:05.118706 22422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "9b336b4bc32449a79c3a4c59060b4f96"
format_stamp: "Formatted at 2026-08-11 07:38:05 on dist-test-slave-7z32"
server_key: "29114edbf29d3718af75a4a909c9c6f9"
server_key_iv: "dd6d20652dd597896bb77835e6eef9e2"
server_key_version: "encryptionkey@0"
I20260811 07:38:05.118956 22422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:05.125941 22422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:05.130577 22422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:05.130992 22422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:05.140895 22422 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41049
I20260811 07:38:05.141002 22529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41049 every 8 connection(s)
I20260811 07:38:05.142289 22422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:05.146066 22530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:05.146807 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22422
I20260811 07:38:05.147045 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:05.147434 22547 external_mini_cluster.cc:1428] Setting key 033b64f1d8b71d32855f8e8323e3ecd3
I20260811 07:38:05.154119 22530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96: Bootstrap starting.
I20260811 07:38:05.154649 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:05.149552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48335 (local address 127.0.0.1:41049)
0811 07:38:05.150286 (+ 734us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:05.150311 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:05.150368 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:38:05.151293 (+ 925us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:05.151322 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:05.151724 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:05.152162 (+ 438us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:05.153119 (+ 957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:05.153125 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:05.153140 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:05.153154 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:05.153225 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:05.153254 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:05.153430 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:05.153505 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 07:38:05.153668 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":181,"threads_started":1}
I20260811 07:38:05.157043 22530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:05.157999 22530 log.cc:824] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:05.159058 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:05.160996 22530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96: No bootstrap required, opened a new log
I20260811 07:38:05.163951 22534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:05.161861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51605 (local address 127.0.0.1:41049)
0811 07:38:05.162029 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:05.162036 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:05.162267 (+ 231us) server_negotiation.cc:407] Connection header received
0811 07:38:05.162447 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:05.162450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:05.162504 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:05.162609 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:05.163473 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:05.163478 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:05.163480 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:05.163493 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:05.163525 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:05.163549 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:05.163653 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:05.163726 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 07:38:05.163778 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:38:05.165696 22530 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b336b4bc32449a79c3a4c59060b4f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41049 } }
I20260811 07:38:05.166076 22530 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:05.166134 22530 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b336b4bc32449a79c3a4c59060b4f96, State: Initialized, Role: FOLLOWER
I20260811 07:38:05.166637 22530 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b336b4bc32449a79c3a4c59060b4f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41049 } }
I20260811 07:38:05.166783 22530 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:05.166899 22530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:05.167019 22530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:05.168291 22530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b336b4bc32449a79c3a4c59060b4f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41049 } }
I20260811 07:38:05.168766 22530 leader_election.cc:302] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b336b4bc32449a79c3a4c59060b4f96; no voters:
I20260811 07:38:05.169304 22530 leader_election.cc:288] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:05.169492 22555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:05.170110 22555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [term 1 LEADER]: Becoming Leader. State: Replica: 9b336b4bc32449a79c3a4c59060b4f96, State: Running, Role: LEADER
I20260811 07:38:05.170619 22555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b336b4bc32449a79c3a4c59060b4f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41049 } }
I20260811 07:38:05.170992 22530 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:05.173237 22557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b336b4bc32449a79c3a4c59060b4f96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b336b4bc32449a79c3a4c59060b4f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41049 } } }
I20260811 07:38:05.173468 22557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:05.173317 22558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b336b4bc32449a79c3a4c59060b4f96. Latest consensus state: current_term: 1 leader_uuid: "9b336b4bc32449a79c3a4c59060b4f96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b336b4bc32449a79c3a4c59060b4f96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41049 } } }
I20260811 07:38:05.173578 22558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96 [sys.catalog]: This master's current role is: LEADER
W20260811 07:38:05.177903 22573 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:05.178040 22573 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:05.178159 22572 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:05.179507 22572 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:05.188269 22572 catalog_manager.cc:1347] Generated new cluster ID: 2575063a96aa4814a0fc49e84e26fdb3
I20260811 07:38:05.188401 22572 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:05.210901 22572 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:05.211510 22572 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:05.223032 22572 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b336b4bc32449a79c3a4c59060b4f96: Generated new TSK 0
I20260811 07:38:05.224277 22572 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:05.235399 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22422
2026-08-11T07:38:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2003 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:05 dist-test-slave-7z32 krb5kdc[22582](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:05 dist-test-slave-7z32 krb5kdc[22582](info): set up 2 sockets
Aug 11 07:38:05 dist-test-slave-7z32 krb5kdc[22582](info): commencing operation
krb5kdc: starting...
W20260811 07:38:06.697392 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.416s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:06 dist-test-slave-7z32 krb5kdc[22582](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:06.907747 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45299
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:07.115367 22603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:07.115841 22603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:07.115896 22603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:07.120996 22603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:07.121170 22603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:07.121215 22603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:07.121253 22603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:07.121323 22603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:07.129184 22603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:07.131045 22603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:07.132773 22603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:38:07.146469 22603 server_base.cc:1034] running on GCE node
W20260811 07:38:07.146711 22610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:07.146412 22615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:07.146420 22613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:07.148095 22603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:07.149893 22603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:07.153389 22603 hybrid_clock.cc:648] HybridClock initialized: now 1786433887153340 us; error 68 us; skew 500 ppm
Aug 11 07:38:07 dist-test-slave-7z32 krb5kdc[22582](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433887, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:07.162999 22603 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:07.164407 22603 webserver.cc:460] Webserver started at http://127.0.0.1:33413/ using document root <none> and password file <none>
I20260811 07:38:07.165215 22603 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:07.165299 22603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:07.165577 22603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:07.168304 22603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "96a841b951694536b7c569c9ef3c9ec9"
format_stamp: "Formatted at 2026-08-11 07:38:07 on dist-test-slave-7z32"
server_key: "817e98730e73687fd3e554ce678832e0"
server_key_iv: "a7ec97dc54efafc3345f8d4d41e331da"
server_key_version: "encryptionkey@0"
I20260811 07:38:07.169073 22603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "96a841b951694536b7c569c9ef3c9ec9"
format_stamp: "Formatted at 2026-08-11 07:38:07 on dist-test-slave-7z32"
server_key: "817e98730e73687fd3e554ce678832e0"
server_key_iv: "a7ec97dc54efafc3345f8d4d41e331da"
server_key_version: "encryptionkey@0"
I20260811 07:38:07.174422 22603 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:38:07.178272 22631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:07.180516 22603 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260811 07:38:07.180747 22603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "96a841b951694536b7c569c9ef3c9ec9"
format_stamp: "Formatted at 2026-08-11 07:38:07 on dist-test-slave-7z32"
server_key: "817e98730e73687fd3e554ce678832e0"
server_key_iv: "a7ec97dc54efafc3345f8d4d41e331da"
server_key_version: "encryptionkey@0"
I20260811 07:38:07.181015 22603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:07.217075 22603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:07.221786 22603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:07.222095 22603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:07.233595 22603 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45299
I20260811 07:38:07.233737 22714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45299 every 8 connection(s)
I20260811 07:38:07.235134 22603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:07.240128 22715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:07.244975 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22603
I20260811 07:38:07.245210 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:07.245617 22547 external_mini_cluster.cc:1428] Setting key ab54b25924594255f9cf7ee44da218ca
I20260811 07:38:07.250677 22715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9: Bootstrap starting.
I20260811 07:38:07.254784 22715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:07.256038 22715 log.cc:824] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:38:07 dist-test-slave-7z32 krb5kdc[22582](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433886, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:38:07.259625 22715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9: No bootstrap required, opened a new log
I20260811 07:38:07.267405 22715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a841b951694536b7c569c9ef3c9ec9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45299 } }
I20260811 07:38:07.267741 22715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:07.267781 22715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a841b951694536b7c569c9ef3c9ec9, State: Initialized, Role: FOLLOWER
I20260811 07:38:07.268414 22715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a841b951694536b7c569c9ef3c9ec9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45299 } }
I20260811 07:38:07.268673 22715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:07.268765 22715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:07.268988 22715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:07.270277 22722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:07.248136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:37619 (local address 127.0.0.1:45299)
0811 07:38:07.248750 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:07.248779 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:07.248830 (+ 51us) server_negotiation.cc:407] Connection header received
0811 07:38:07.249730 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:07.249754 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:07.250238 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:07.250641 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:07.252308 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:07.253581 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:07.255108 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:07.255776 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:07.255980 (+ 204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:07.259597 (+ 3617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:07.259606 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:07.259630 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:07.259679 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:07.263502 (+ 3823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:07.265092 (+ 1590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:07.265105 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:07.265116 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:07.265426 (+ 310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:07.266276 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:07.266280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:07.266282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:07.267073 (+ 791us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:07.267380 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:07.268365 (+ 985us) server_negotiation.cc:299] Negotiation successful
0811 07:38:07.268811 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":408,"thread_start_us":197,"threads_started":1}
I20260811 07:38:07.270318 22715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a841b951694536b7c569c9ef3c9ec9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45299 } }
I20260811 07:38:07.271718 22715 leader_election.cc:302] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96a841b951694536b7c569c9ef3c9ec9; no voters:
I20260811 07:38:07.272245 22715 leader_election.cc:288] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:07.272354 22725 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:07.272576 22725 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [term 1 LEADER]: Becoming Leader. State: Replica: 96a841b951694536b7c569c9ef3c9ec9, State: Running, Role: LEADER
I20260811 07:38:07.273001 22725 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a841b951694536b7c569c9ef3c9ec9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45299 } }
I20260811 07:38:07.273952 22715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:07.275621 22728 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96a841b951694536b7c569c9ef3c9ec9. Latest consensus state: current_term: 1 leader_uuid: "96a841b951694536b7c569c9ef3c9ec9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a841b951694536b7c569c9ef3c9ec9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45299 } } }
I20260811 07:38:07.275920 22728 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:07.276609 22727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96a841b951694536b7c569c9ef3c9ec9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96a841b951694536b7c569c9ef3c9ec9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45299 } } }
I20260811 07:38:07.276875 22727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:07.277554 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:07.278370 22741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:07.284209 22741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:07.295637 22741 catalog_manager.cc:1347] Generated new cluster ID: 9e31f83531df454c81dbc8d752d7e27d
I20260811 07:38:07.295771 22741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:07.298082 22722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:07.281301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:43819 (local address 127.0.0.1:45299)
0811 07:38:07.281920 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:07.281927 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:07.282679 (+ 752us) server_negotiation.cc:407] Connection header received
0811 07:38:07.282857 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:07.282862 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:07.282959 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:07.283147 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:07.284601 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:07.285480 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:07.287201 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:07.287704 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:07.287859 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:07.291377 (+ 3518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:07.291382 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:07.291385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:07.291435 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:07.294100 (+ 2665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:07.295171 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:07.295177 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:07.295179 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:07.295463 (+ 284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:07.296480 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:07.296487 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:07.296492 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:07.296796 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:07.297004 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:07.297704 (+ 700us) server_negotiation.cc:299] Negotiation successful
0811 07:38:07.297853 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457}
I20260811 07:38:07.315831 22741 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:07.318270 22741 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:07.327356 22741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96a841b951694536b7c569c9ef3c9ec9: Generated new TSK 0
I20260811 07:38:07.328622 22741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:07.337605 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22603
W20260811 07:38:07.356822 22579 connection.cc:535] client connection to 127.0.0.1:45299 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45299): Connection reset by peer (error 104)
2026-08-11T07:38:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2092 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:07 dist-test-slave-7z32 krb5kdc[22769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:07 dist-test-slave-7z32 krb5kdc[22769](info): set up 2 sockets
Aug 11 07:38:07 dist-test-slave-7z32 krb5kdc[22769](info): commencing operation
krb5kdc: starting...
W20260811 07:38:08.809567 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.437s user 0.000s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:08 dist-test-slave-7z32 krb5kdc[22769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433888, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:09.017549 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36557
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36557
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:09.164279 22786 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:09.164635 22786 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:09.164682 22786 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:09.168921 22786 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:09.169015 22786 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:09.169037 22786 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:09.169054 22786 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:09.169071 22786 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:09.175064 22786 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22786
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:09.176366 22786 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:09.177528 22786 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:09.188956 22793 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:09.188983 22792 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:09.189248 22786 server_base.cc:1034] running on GCE node
W20260811 07:38:09.188975 22795 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:09.190338 22786 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:09.192158 22786 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:09.193554 22786 hybrid_clock.cc:648] HybridClock initialized: now 1786433889193508 us; error 75 us; skew 500 ppm
Aug 11 07:38:09 dist-test-slave-7z32 krb5kdc[22769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433889, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:09.198393 22786 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:09.200554 22786 webserver.cc:460] Webserver started at http://127.0.0.1:44591/ using document root <none> and password file <none>
I20260811 07:38:09.201327 22786 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:09.201416 22786 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:09.201619 22786 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:09.204382 22786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "eefc06701ba54ed3aa0b81e2956e833c"
format_stamp: "Formatted at 2026-08-11 07:38:09 on dist-test-slave-7z32"
server_key: "137d1ddc790be7682aaf8e109f699a20"
server_key_iv: "ca144ecbfd368e68eefcd434393758b4"
server_key_version: "encryptionkey@0"
I20260811 07:38:09.205080 22786 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "eefc06701ba54ed3aa0b81e2956e833c"
format_stamp: "Formatted at 2026-08-11 07:38:09 on dist-test-slave-7z32"
server_key: "137d1ddc790be7682aaf8e109f699a20"
server_key_iv: "ca144ecbfd368e68eefcd434393758b4"
server_key_version: "encryptionkey@0"
I20260811 07:38:09.211243 22786 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260811 07:38:09.215265 22805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:09.217459 22786 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:38:09.217672 22786 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "eefc06701ba54ed3aa0b81e2956e833c"
format_stamp: "Formatted at 2026-08-11 07:38:09 on dist-test-slave-7z32"
server_key: "137d1ddc790be7682aaf8e109f699a20"
server_key_iv: "ca144ecbfd368e68eefcd434393758b4"
server_key_version: "encryptionkey@0"
I20260811 07:38:09.217808 22786 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:09.243137 22786 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:09.249689 22786 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:09.249950 22786 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:09.261960 22786 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36557
I20260811 07:38:09.262038 22896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36557 every 8 connection(s)
I20260811 07:38:09.263422 22786 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:09.268501 22897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:09.271338 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22786
I20260811 07:38:09.271552 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:09.271936 22547 external_mini_cluster.cc:1428] Setting key 395737f65321cd420085a43ab543b00a
I20260811 07:38:09.279742 22897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c: Bootstrap starting.
I20260811 07:38:09.284991 22897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:09.286739 22897 log.cc:824] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:09.287336 22900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:09.274513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:43989 (local address 127.0.0.1:36557)
0811 07:38:09.275206 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:09.275226 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:09.275276 (+ 50us) server_negotiation.cc:407] Connection header received
0811 07:38:09.276253 (+ 977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:09.276277 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:09.276752 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:09.277130 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:09.277876 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:09.279306 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:09.281107 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:09.281970 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:09.282228 (+ 258us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:09.284423 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:09.284432 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:09.284459 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:09.285033 (+ 574us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:09.285202 (+ 169us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:09.285262 (+ 60us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:09.285448 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:09.285892 (+ 444us) server_negotiation.cc:299] Negotiation successful
0811 07:38:09.286118 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":492,"thread_start_us":285,"threads_started":1}
I20260811 07:38:09.290568 22897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c: No bootstrap required, opened a new log
I20260811 07:38:09.291872 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:09.297328 22897 raft_consensus.cc:348] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eefc06701ba54ed3aa0b81e2956e833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36557 } }
I20260811 07:38:09.297853 22897 raft_consensus.cc:374] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:09.297950 22897 raft_consensus.cc:729] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eefc06701ba54ed3aa0b81e2956e833c, State: Initialized, Role: FOLLOWER
I20260811 07:38:09.298748 22897 consensus_queue.cc:260] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eefc06701ba54ed3aa0b81e2956e833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36557 } }
I20260811 07:38:09.299036 22897 raft_consensus.cc:388] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:09.299221 22897 raft_consensus.cc:482] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:09.299453 22897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:09.301718 22897 raft_consensus.cc:504] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eefc06701ba54ed3aa0b81e2956e833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36557 } }
I20260811 07:38:09.302624 22897 leader_election.cc:302] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eefc06701ba54ed3aa0b81e2956e833c; no voters:
I20260811 07:38:09.302892 22900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:09.295704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:54387 (local address 127.0.0.1:36557)
0811 07:38:09.295955 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:09.295963 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:09.296238 (+ 275us) server_negotiation.cc:407] Connection header received
0811 07:38:09.296394 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:09.296399 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:09.296480 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:09.296627 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:09.297036 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:09.297826 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:09.299644 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:09.300179 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:09.300337 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:09.301830 (+ 1493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:09.301833 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:09.301836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:09.301857 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:09.301901 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:09.301915 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:09.302219 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:09.302509 (+ 290us) server_negotiation.cc:299] Negotiation successful
0811 07:38:09.302563 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260811 07:38:09.303401 22897 leader_election.cc:288] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:09.303516 22913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:09.303813 22913 raft_consensus.cc:686] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [term 1 LEADER]: Becoming Leader. State: Replica: eefc06701ba54ed3aa0b81e2956e833c, State: Running, Role: LEADER
I20260811 07:38:09.304311 22913 consensus_queue.cc:237] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eefc06701ba54ed3aa0b81e2956e833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36557 } }
I20260811 07:38:09.305763 22897 sys_catalog.cc:564] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:09.307344 22914 sys_catalog.cc:455] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [sys.catalog]: SysCatalogTable state changed. Reason: New leader eefc06701ba54ed3aa0b81e2956e833c. Latest consensus state: current_term: 1 leader_uuid: "eefc06701ba54ed3aa0b81e2956e833c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eefc06701ba54ed3aa0b81e2956e833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36557 } } }
I20260811 07:38:09.307614 22914 sys_catalog.cc:458] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:09.308059 22915 sys_catalog.cc:455] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eefc06701ba54ed3aa0b81e2956e833c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eefc06701ba54ed3aa0b81e2956e833c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36557 } } }
I20260811 07:38:09.308205 22915 sys_catalog.cc:458] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:09.308264 22926 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:09.313632 22926 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:09.324702 22926 catalog_manager.cc:1347] Generated new cluster ID: 131314f010ee416aa95bf4c66cd99a42
I20260811 07:38:09.324818 22926 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:09.349395 22926 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:09.351181 22926 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:09.359860 22926 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eefc06701ba54ed3aa0b81e2956e833c: Generated new TSK 0
I20260811 07:38:09.360944 22926 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:09.367851 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22786
W20260811 07:38:09.392351 22766 connection.cc:535] client connection to 127.0.0.1:36557 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36557): Connection reset by peer (error 104)
2026-08-11T07:38:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2035 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:09 dist-test-slave-7z32 krb5kdc[22941](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:09 dist-test-slave-7z32 krb5kdc[22941](info): set up 2 sockets
Aug 11 07:38:09 dist-test-slave-7z32 krb5kdc[22941](info): commencing operation
krb5kdc: starting...
W20260811 07:38:10.847127 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.439s user 0.008s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:10 dist-test-slave-7z32 krb5kdc[22941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:11.056751 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42929
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43269
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42929
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:11.245048 22960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:11.245512 22960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:11.245568 22960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:11.250223 22960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:11.250336 22960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:11.250360 22960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:11.250378 22960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:11.250394 22960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:11.257220 22960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43269
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42929
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42929
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:11.258893 22960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:11.260310 22960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:11.272768 22967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:11.272773 22973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:11.272773 22966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:11.273624 22960 server_base.cc:1034] running on GCE node
I20260811 07:38:11.274622 22960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:11.276439 22960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:11.277779 22960 hybrid_clock.cc:648] HybridClock initialized: now 1786433891277746 us; error 61 us; skew 500 ppm
Aug 11 07:38:11 dist-test-slave-7z32 krb5kdc[22941](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433891, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:11.282533 22960 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:11.284566 22960 webserver.cc:460] Webserver started at http://127.0.0.1:39991/ using document root <none> and password file <none>
I20260811 07:38:11.285571 22960 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:11.285724 22960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:11.286077 22960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:11.289355 22960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "0b20b9e4e2804a9aa0f22962a977429c"
format_stamp: "Formatted at 2026-08-11 07:38:11 on dist-test-slave-7z32"
server_key: "db309f1c053fed9865ee95bb7cb69fbe"
server_key_iv: "9a7857261e31956e9eb4224d6eb5453a"
server_key_version: "encryptionkey@0"
I20260811 07:38:11.290268 22960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "0b20b9e4e2804a9aa0f22962a977429c"
format_stamp: "Formatted at 2026-08-11 07:38:11 on dist-test-slave-7z32"
server_key: "db309f1c053fed9865ee95bb7cb69fbe"
server_key_iv: "9a7857261e31956e9eb4224d6eb5453a"
server_key_version: "encryptionkey@0"
I20260811 07:38:11.296465 22960 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260811 07:38:11.300563 22985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:11.303603 22960 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:38:11.303831 22960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "0b20b9e4e2804a9aa0f22962a977429c"
format_stamp: "Formatted at 2026-08-11 07:38:11 on dist-test-slave-7z32"
server_key: "db309f1c053fed9865ee95bb7cb69fbe"
server_key_iv: "9a7857261e31956e9eb4224d6eb5453a"
server_key_version: "encryptionkey@0"
I20260811 07:38:11.304072 22960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:11.311100 22960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:11.316632 22960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:11.316874 22960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:11.328998 22960 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42929
I20260811 07:38:11.329154 23058 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42929 every 8 connection(s)
I20260811 07:38:11.331159 22960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:11.331529 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 22960
I20260811 07:38:11.331766 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:11.332470 22547 external_mini_cluster.cc:1428] Setting key f11ab5362f15c7b24fc4bf91569cb594
I20260811 07:38:11.336513 23060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:11.340657 23064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:11.334947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:40701 (local address 127.0.0.1:42929)
0811 07:38:11.335719 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:11.335742 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:11.335809 (+ 67us) server_negotiation.cc:407] Connection header received
0811 07:38:11.336820 (+ 1011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:11.336848 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:11.337270 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:11.337751 (+ 481us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:11.338931 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:11.338938 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:11.338954 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:11.338969 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:11.339038 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:11.339064 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:11.339277 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:11.339368 (+ 91us) server_negotiation.cc:299] Negotiation successful
0811 07:38:11.339582 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":531,"thread_start_us":242,"threads_started":1}
I20260811 07:38:11.346364 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:11.346424 23060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c: Bootstrap starting.
I20260811 07:38:11.350184 23060 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:11.351351 23064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:11.349106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:45145 (local address 127.0.0.1:42929)
0811 07:38:11.349278 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:11.349284 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:11.349553 (+ 269us) server_negotiation.cc:407] Connection header received
0811 07:38:11.349721 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:11.349725 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:11.349776 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:11.349872 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:11.350862 (+ 990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:11.350865 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:11.350868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:11.350881 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:11.350920 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:11.350935 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:11.351050 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:11.351118 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 07:38:11.351175 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:38:11.351486 23060 log.cc:824] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:11.354626 23060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c: No bootstrap required, opened a new log
I20260811 07:38:11.360596 23060 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b20b9e4e2804a9aa0f22962a977429c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42929 } }
I20260811 07:38:11.361054 23060 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:11.361145 23060 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b20b9e4e2804a9aa0f22962a977429c, State: Initialized, Role: FOLLOWER
I20260811 07:38:11.361897 23060 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b20b9e4e2804a9aa0f22962a977429c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42929 } }
I20260811 07:38:11.362097 23060 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:11.362159 23060 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:11.362344 23060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:11.364017 23060 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b20b9e4e2804a9aa0f22962a977429c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42929 } }
I20260811 07:38:11.364627 23060 leader_election.cc:302] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0b20b9e4e2804a9aa0f22962a977429c; no voters:
I20260811 07:38:11.365345 23060 leader_election.cc:288] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:11.365492 23075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:11.366065 23075 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [term 1 LEADER]: Becoming Leader. State: Replica: 0b20b9e4e2804a9aa0f22962a977429c, State: Running, Role: LEADER
I20260811 07:38:11.367012 23075 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b20b9e4e2804a9aa0f22962a977429c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42929 } }
I20260811 07:38:11.368359 23060 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:11.370595 23076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0b20b9e4e2804a9aa0f22962a977429c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b20b9e4e2804a9aa0f22962a977429c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42929 } } }
I20260811 07:38:11.370883 23076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:11.371225 23077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0b20b9e4e2804a9aa0f22962a977429c. Latest consensus state: current_term: 1 leader_uuid: "0b20b9e4e2804a9aa0f22962a977429c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0b20b9e4e2804a9aa0f22962a977429c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42929 } } }
I20260811 07:38:11.371361 23077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:11.371606 23090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:11.375639 23090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:11.384886 23090 catalog_manager.cc:1347] Generated new cluster ID: 30d309f4de3144bea5e0a2c724818236
I20260811 07:38:11.385028 23090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:11.397408 23090 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:11.397845 23090 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:11.404222 23090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0b20b9e4e2804a9aa0f22962a977429c: Generated new TSK 0
I20260811 07:38:11.405206 23090 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:11.420200 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 22960
2026-08-11T07:38:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2052 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:11 dist-test-slave-7z32 krb5kdc[23108](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:11 dist-test-slave-7z32 krb5kdc[23108](info): set up 2 sockets
Aug 11 07:38:11 dist-test-slave-7z32 krb5kdc[23108](info): commencing operation
krb5kdc: starting...
W20260811 07:38:12.873201 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.412s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:13 dist-test-slave-7z32 krb5kdc[23108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:13.071902 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45247
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45247
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:13.239295 23127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:13.239773 23127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:13.239899 23127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:13.245695 23127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:13.245848 23127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:13.245872 23127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:13.245893 23127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:13.245910 23127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:13.253948 23127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45247
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:13.255872 23127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:13.257447 23127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:13.270440 23134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:13.270511 23136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:13.270911 23127 server_base.cc:1034] running on GCE node
W20260811 07:38:13.270577 23133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:13.271884 23127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:13.273547 23127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:13.275002 23127 hybrid_clock.cc:648] HybridClock initialized: now 1786433893274960 us; error 74 us; skew 500 ppm
Aug 11 07:38:13 dist-test-slave-7z32 krb5kdc[23108](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433893, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:13.286665 23127 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:13.288604 23127 webserver.cc:460] Webserver started at http://127.0.0.1:35347/ using document root <none> and password file <none>
I20260811 07:38:13.290246 23127 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:13.290369 23127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:13.290709 23127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:13.293802 23127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "922a18c12d6e46789779274ac09c90e3"
format_stamp: "Formatted at 2026-08-11 07:38:13 on dist-test-slave-7z32"
server_key: "dd2c85a43cd94bcf0e02737da1af2253"
server_key_iv: "d307f33da74bdebef218ef5669d738b9"
server_key_version: "encryptionkey@0"
I20260811 07:38:13.294718 23127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "922a18c12d6e46789779274ac09c90e3"
format_stamp: "Formatted at 2026-08-11 07:38:13 on dist-test-slave-7z32"
server_key: "dd2c85a43cd94bcf0e02737da1af2253"
server_key_iv: "d307f33da74bdebef218ef5669d738b9"
server_key_version: "encryptionkey@0"
I20260811 07:38:13.301267 23127 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260811 07:38:13.306083 23148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:13.308795 23127 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260811 07:38:13.309155 23127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "922a18c12d6e46789779274ac09c90e3"
format_stamp: "Formatted at 2026-08-11 07:38:13 on dist-test-slave-7z32"
server_key: "dd2c85a43cd94bcf0e02737da1af2253"
server_key_iv: "d307f33da74bdebef218ef5669d738b9"
server_key_version: "encryptionkey@0"
I20260811 07:38:13.309396 23127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:13.330583 23127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:13.336170 23127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:13.336460 23127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:13.347656 23127 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45247
I20260811 07:38:13.347754 23245 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45247 every 8 connection(s)
I20260811 07:38:13.349202 23127 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:13.353046 23247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:13.356340 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23127
I20260811 07:38:13.356513 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:13.356981 22547 external_mini_cluster.cc:1428] Setting key f706af8e16f361e5242859578b850879
I20260811 07:38:13.360587 23247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3: Bootstrap starting.
I20260811 07:38:13.363656 23247 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:13.364651 23247 log.cc:824] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:13.367267 23247 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3: No bootstrap required, opened a new log
Aug 11 07:38:13 dist-test-slave-7z32 krb5kdc[23108](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 07:38:13.372385 23247 raft_consensus.cc:348] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "922a18c12d6e46789779274ac09c90e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45247 } }
I20260811 07:38:13.372752 23247 raft_consensus.cc:374] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:13.372820 23247 raft_consensus.cc:729] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922a18c12d6e46789779274ac09c90e3, State: Initialized, Role: FOLLOWER
I20260811 07:38:13.373384 23247 consensus_queue.cc:260] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "922a18c12d6e46789779274ac09c90e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45247 } }
I20260811 07:38:13.373586 23247 raft_consensus.cc:388] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:13.373693 23247 raft_consensus.cc:482] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:13.373834 23247 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:13.375269 23247 raft_consensus.cc:504] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "922a18c12d6e46789779274ac09c90e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45247 } }
I20260811 07:38:13.375736 23247 leader_election.cc:302] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 922a18c12d6e46789779274ac09c90e3; no voters:
I20260811 07:38:13.376164 23247 leader_election.cc:288] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:13.376556 23254 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:13.376948 23254 raft_consensus.cc:686] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [term 1 LEADER]: Becoming Leader. State: Replica: 922a18c12d6e46789779274ac09c90e3, State: Running, Role: LEADER
I20260811 07:38:13.377640 23254 consensus_queue.cc:237] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "922a18c12d6e46789779274ac09c90e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45247 } }
I20260811 07:38:13.377862 23247 sys_catalog.cc:564] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:13.378362 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:13.359227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:41725 (local address 127.0.0.1:45247)
0811 07:38:13.359880 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:13.359902 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:13.359958 (+ 56us) server_negotiation.cc:407] Connection header received
0811 07:38:13.360936 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:13.360963 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:13.361447 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:13.361875 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:13.363118 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:13.364665 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:13.365858 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:13.366559 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:13.366753 (+ 194us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:13.370541 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:13.370550 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:13.370579 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:13.370630 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:13.373000 (+ 2370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:13.374183 (+ 1183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:13.374191 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:13.374198 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:13.374373 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:13.375132 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:13.375139 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:13.375143 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:13.375769 (+ 626us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:13.376035 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:13.376661 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 07:38:13.377039 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":190,"threads_started":1}
I20260811 07:38:13.380425 23255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 922a18c12d6e46789779274ac09c90e3. Latest consensus state: current_term: 1 leader_uuid: "922a18c12d6e46789779274ac09c90e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "922a18c12d6e46789779274ac09c90e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45247 } } }
I20260811 07:38:13.381850 23255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:13.380647 23256 sys_catalog.cc:455] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "922a18c12d6e46789779274ac09c90e3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "922a18c12d6e46789779274ac09c90e3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45247 } } }
I20260811 07:38:13.382365 23256 sys_catalog.cc:458] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:13.382797 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 07:38:13.383948 23279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:13.384056 23279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:13.384148 23282 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:13.385432 23282 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:13.394687 23282 catalog_manager.cc:1347] Generated new cluster ID: f6d688f568c34e539d0d3a92c9a7437f
I20260811 07:38:13.395144 23282 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:13.398418 23252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:13.385491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:54395 (local address 127.0.0.1:45247)
0811 07:38:13.385675 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:13.385681 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:13.385941 (+ 260us) server_negotiation.cc:407] Connection header received
0811 07:38:13.386159 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:13.386163 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:13.386229 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:13.386336 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:13.387553 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:13.388355 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:13.389739 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:13.390148 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:13.390274 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:13.393437 (+ 3163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:13.393442 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:13.393446 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:13.393489 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:13.395992 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:13.396721 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:13.396726 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:13.396733 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:13.396833 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:13.397247 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:13.397251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:13.397253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:13.397490 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:13.397686 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:13.398015 (+ 329us) server_negotiation.cc:299] Negotiation successful
0811 07:38:13.398154 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 07:38:13.417605 23282 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:13.419044 23282 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:13.425279 23282 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 922a18c12d6e46789779274ac09c90e3: Generated new TSK 0
I20260811 07:38:13.426761 23282 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:13.437328 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23127
W20260811 07:38:13.459626 23104 connection.cc:535] client connection to 127.0.0.1:45247 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45247): Connection reset by peer (error 104)
2026-08-11T07:38:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2015 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:13 dist-test-slave-7z32 krb5kdc[23301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:13 dist-test-slave-7z32 krb5kdc[23301](info): set up 2 sockets
Aug 11 07:38:13 dist-test-slave-7z32 krb5kdc[23301](info): commencing operation
krb5kdc: starting...
W20260811 07:38:14.886719 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.411s user 0.005s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:15 dist-test-slave-7z32 krb5kdc[23301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433895, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:15.076113 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40231
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44367
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:15.212250 23328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:15.212666 23328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:15.212714 23328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:15.217331 23328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:15.217422 23328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:15.217442 23328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:15.217460 23328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:15.217476 23328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:15.224172 23328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44367
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40231
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:15.225711 23328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:15.227084 23328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:15.239799 23339 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:15.239948 23328 server_base.cc:1034] running on GCE node
W20260811 07:38:15.239732 23343 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:15.239719 23338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:15.240952 23328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:15.242331 23328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:15.243722 23328 hybrid_clock.cc:648] HybridClock initialized: now 1786433895243690 us; error 60 us; skew 500 ppm
Aug 11 07:38:15 dist-test-slave-7z32 krb5kdc[23301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433895, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:15.247807 23328 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:15.249120 23328 webserver.cc:460] Webserver started at http://127.0.0.1:37187/ using document root <none> and password file <none>
I20260811 07:38:15.249922 23328 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:15.250036 23328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:15.250334 23328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:15.253010 23328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "d08af7a0159141f38b2b03bb09f976c1"
format_stamp: "Formatted at 2026-08-11 07:38:15 on dist-test-slave-7z32"
server_key: "5052a2525b2c1951376ed1ede579e467"
server_key_iv: "b48f57e170c96083279f7815e83c1aac"
server_key_version: "encryptionkey@0"
I20260811 07:38:15.253733 23328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "d08af7a0159141f38b2b03bb09f976c1"
format_stamp: "Formatted at 2026-08-11 07:38:15 on dist-test-slave-7z32"
server_key: "5052a2525b2c1951376ed1ede579e467"
server_key_iv: "b48f57e170c96083279f7815e83c1aac"
server_key_version: "encryptionkey@0"
I20260811 07:38:15.258658 23328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.006s
I20260811 07:38:15.262151 23359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:15.264045 23328 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:38:15.264266 23328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "d08af7a0159141f38b2b03bb09f976c1"
format_stamp: "Formatted at 2026-08-11 07:38:15 on dist-test-slave-7z32"
server_key: "5052a2525b2c1951376ed1ede579e467"
server_key_iv: "b48f57e170c96083279f7815e83c1aac"
server_key_version: "encryptionkey@0"
I20260811 07:38:15.264421 23328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:15.289230 23328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:15.293520 23328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:15.293794 23328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:15.303311 23328 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40231
I20260811 07:38:15.303445 23433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40231 every 8 connection(s)
I20260811 07:38:15.304628 23328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:15.308739 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23328
I20260811 07:38:15.308893 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:15.309474 22547 external_mini_cluster.cc:1428] Setting key 7a7888787106337b1d44fbc7cf53ce4d
I20260811 07:38:15.309707 23435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:15.320720 23435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1: Bootstrap starting.
I20260811 07:38:15.324967 23435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:15.325232 23441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:15.311783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:53269 (local address 127.0.0.1:40231)
0811 07:38:15.312497 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:15.312523 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:15.312590 (+ 67us) server_negotiation.cc:407] Connection header received
0811 07:38:15.314121 (+ 1531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:15.314162 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:15.314928 (+ 766us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:15.315525 (+ 597us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:15.316145 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:15.317844 (+ 1699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:15.319341 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:15.320188 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:15.320437 (+ 249us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:15.322246 (+ 1809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:15.322254 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:15.322278 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:15.323041 (+ 763us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:15.323167 (+ 126us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:15.323210 (+ 43us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:15.323403 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:15.323703 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 07:38:15.323907 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":471,"thread_start_us":186,"threads_started":1}
I20260811 07:38:15.326140 23435 log.cc:824] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:15.329355 23435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1: No bootstrap required, opened a new log
I20260811 07:38:15.330044 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:15.335562 23435 raft_consensus.cc:348] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08af7a0159141f38b2b03bb09f976c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40231 } }
I20260811 07:38:15.336024 23435 raft_consensus.cc:374] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:15.336117 23435 raft_consensus.cc:729] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d08af7a0159141f38b2b03bb09f976c1, State: Initialized, Role: FOLLOWER
I20260811 07:38:15.336807 23435 consensus_queue.cc:260] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08af7a0159141f38b2b03bb09f976c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40231 } }
I20260811 07:38:15.337020 23435 raft_consensus.cc:388] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:15.337128 23435 raft_consensus.cc:482] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:15.337272 23435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:15.338932 23441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:15.333215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:49009 (local address 127.0.0.1:40231)
0811 07:38:15.333482 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:15.333487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:15.333711 (+ 224us) server_negotiation.cc:407] Connection header received
0811 07:38:15.333860 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:15.333862 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:15.333925 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:15.334019 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:15.334472 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:15.335153 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:15.336382 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:15.336672 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:15.336789 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:15.337972 (+ 1183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:15.337975 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:15.337977 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:15.337994 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:15.338030 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:15.338043 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:15.338131 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:15.338370 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 07:38:15.338640 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139}
I20260811 07:38:15.339035 23435 raft_consensus.cc:504] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08af7a0159141f38b2b03bb09f976c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40231 } }
I20260811 07:38:15.339620 23435 leader_election.cc:302] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d08af7a0159141f38b2b03bb09f976c1; no voters:
I20260811 07:38:15.340143 23435 leader_election.cc:288] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:15.340395 23456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:15.340840 23456 raft_consensus.cc:686] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [term 1 LEADER]: Becoming Leader. State: Replica: d08af7a0159141f38b2b03bb09f976c1, State: Running, Role: LEADER
I20260811 07:38:15.341348 23456 consensus_queue.cc:237] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08af7a0159141f38b2b03bb09f976c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40231 } }
I20260811 07:38:15.342168 23435 sys_catalog.cc:564] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:15.342955 23456 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d08af7a0159141f38b2b03bb09f976c1. Latest consensus state: current_term: 1 leader_uuid: "d08af7a0159141f38b2b03bb09f976c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08af7a0159141f38b2b03bb09f976c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40231 } } }
I20260811 07:38:15.343145 23456 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:15.344318 23462 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:15.346930 23458 sys_catalog.cc:455] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d08af7a0159141f38b2b03bb09f976c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d08af7a0159141f38b2b03bb09f976c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40231 } } }
I20260811 07:38:15.347159 23458 sys_catalog.cc:458] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:15.349009 23462 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:15.357791 23462 catalog_manager.cc:1347] Generated new cluster ID: 286ebbea7ecd43e0b1d0131cb1d6a7e1
I20260811 07:38:15.357929 23462 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:15.372542 23462 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:15.374205 23462 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:15.386740 23462 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d08af7a0159141f38b2b03bb09f976c1: Generated new TSK 0
I20260811 07:38:15.388130 23462 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:15.401549 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23328
W20260811 07:38:15.418597 23295 connection.cc:535] client connection to 127.0.0.1:40231 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40231): Connection reset by peer (error 104)
2026-08-11T07:38:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1959 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:15 dist-test-slave-7z32 krb5kdc[23501](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:15 dist-test-slave-7z32 krb5kdc[23501](info): set up 2 sockets
Aug 11 07:38:15 dist-test-slave-7z32 krb5kdc[23501](info): commencing operation
krb5kdc: starting...
W20260811 07:38:16.812459 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.376s user 0.002s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:16 dist-test-slave-7z32 krb5kdc[23501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 07:38:17.030200 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42069
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42791
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42069
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:17.209972 23524 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:17.210772 23524 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:17.210990 23524 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:17.218734 23524 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:17.219005 23524 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:17.219049 23524 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:17.219095 23524 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:17.219133 23524 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:17.229188 23524 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42791
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42069
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23524
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:17.231544 23524 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:17.234905 23524 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:17.251997 23533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:17.252029 23535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:17.252149 23524 server_base.cc:1034] running on GCE node
W20260811 07:38:17.252029 23537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:17.253773 23524 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:17.255888 23524 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:17.257759 23524 hybrid_clock.cc:648] HybridClock initialized: now 1786433897257718 us; error 49 us; skew 500 ppm
Aug 11 07:38:17 dist-test-slave-7z32 krb5kdc[23501](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433897, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:17.263788 23524 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 07:38:17.265571 23524 webserver.cc:460] Webserver started at http://127.0.0.1:45207/ using document root <none> and password file <none>
I20260811 07:38:17.266530 23524 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:17.266680 23524 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:17.267078 23524 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:17.271170 23524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "da3184f2fc984cb4b82eb383a93cb93c"
format_stamp: "Formatted at 2026-08-11 07:38:17 on dist-test-slave-7z32"
server_key: "edf368f6abbf546852f3dda69509432e"
server_key_iv: "9cc3cf0c4767d0edd4a8949a7ef4e703"
server_key_version: "encryptionkey@0"
I20260811 07:38:17.272405 23524 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "da3184f2fc984cb4b82eb383a93cb93c"
format_stamp: "Formatted at 2026-08-11 07:38:17 on dist-test-slave-7z32"
server_key: "edf368f6abbf546852f3dda69509432e"
server_key_iv: "9cc3cf0c4767d0edd4a8949a7ef4e703"
server_key_version: "encryptionkey@0"
I20260811 07:38:17.280368 23524 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s
I20260811 07:38:17.285043 23551 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:17.288383 23524 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.001s
I20260811 07:38:17.288758 23524 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "da3184f2fc984cb4b82eb383a93cb93c"
format_stamp: "Formatted at 2026-08-11 07:38:17 on dist-test-slave-7z32"
server_key: "edf368f6abbf546852f3dda69509432e"
server_key_iv: "9cc3cf0c4767d0edd4a8949a7ef4e703"
server_key_version: "encryptionkey@0"
I20260811 07:38:17.289004 23524 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:17.297087 23524 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:17.302878 23524 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:17.303233 23524 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:17.314878 23524 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42069
I20260811 07:38:17.315064 23635 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42069 every 8 connection(s)
I20260811 07:38:17.316391 23524 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:17.320602 23637 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:17.325441 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23524
I20260811 07:38:17.325634 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:17.325997 22547 external_mini_cluster.cc:1428] Setting key c7d942dc81957e4278d9f78cbf236904
I20260811 07:38:17.328780 23637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c: Bootstrap starting.
I20260811 07:38:17.333555 23637 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:17.334983 23637 log.cc:824] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:17.336802 23645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:17.328071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:60881 (local address 127.0.0.1:42069)
0811 07:38:17.328827 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:17.328850 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:17.328957 (+ 107us) server_negotiation.cc:407] Connection header received
0811 07:38:17.329957 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:17.329985 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:17.330482 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:17.331083 (+ 601us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:17.334078 (+ 2995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:17.334086 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:17.334110 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:17.334130 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:17.334261 (+ 131us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:17.334298 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:17.334489 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:17.334725 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 07:38:17.335112 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":222,"threads_started":1}
I20260811 07:38:17.338701 23637 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c: No bootstrap required, opened a new log
I20260811 07:38:17.342166 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:17.344146 23637 raft_consensus.cc:348] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da3184f2fc984cb4b82eb383a93cb93c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42069 } }
I20260811 07:38:17.344532 23637 raft_consensus.cc:374] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:17.344641 23637 raft_consensus.cc:729] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da3184f2fc984cb4b82eb383a93cb93c, State: Initialized, Role: FOLLOWER
I20260811 07:38:17.345609 23637 consensus_queue.cc:260] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da3184f2fc984cb4b82eb383a93cb93c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42069 } }
I20260811 07:38:17.345898 23637 raft_consensus.cc:388] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:17.346161 23637 raft_consensus.cc:482] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:17.346343 23637 raft_consensus.cc:3037] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:17.348142 23637 raft_consensus.cc:504] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da3184f2fc984cb4b82eb383a93cb93c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42069 } }
I20260811 07:38:17.348831 23637 leader_election.cc:302] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da3184f2fc984cb4b82eb383a93cb93c; no voters:
I20260811 07:38:17.349040 23645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:17.345829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.194:41965 (local address 127.0.0.1:42069)
0811 07:38:17.346232 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:17.346251 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:17.346509 (+ 258us) server_negotiation.cc:407] Connection header received
0811 07:38:17.346789 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:17.346793 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:17.346931 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:17.347054 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:17.348217 (+ 1163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:17.348221 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:17.348223 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:17.348240 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:17.348282 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:17.348295 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:17.348483 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:17.348656 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 07:38:17.348727 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179}
I20260811 07:38:17.349376 23637 leader_election.cc:288] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:17.349519 23654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:17.349879 23654 raft_consensus.cc:686] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [term 1 LEADER]: Becoming Leader. State: Replica: da3184f2fc984cb4b82eb383a93cb93c, State: Running, Role: LEADER
I20260811 07:38:17.350529 23654 consensus_queue.cc:237] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da3184f2fc984cb4b82eb383a93cb93c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42069 } }
I20260811 07:38:17.351330 23637 sys_catalog.cc:564] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:17.352372 23654 sys_catalog.cc:455] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [sys.catalog]: SysCatalogTable state changed. Reason: New leader da3184f2fc984cb4b82eb383a93cb93c. Latest consensus state: current_term: 1 leader_uuid: "da3184f2fc984cb4b82eb383a93cb93c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da3184f2fc984cb4b82eb383a93cb93c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42069 } } }
I20260811 07:38:17.352572 23654 sys_catalog.cc:458] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:17.352928 23657 sys_catalog.cc:455] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da3184f2fc984cb4b82eb383a93cb93c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da3184f2fc984cb4b82eb383a93cb93c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42069 } } }
I20260811 07:38:17.353082 23657 sys_catalog.cc:458] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c [sys.catalog]: This master's current role is: LEADER
W20260811 07:38:17.358368 23682 catalog_manager.cc:1558] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:17.358688 23682 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:17.358882 23670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:17.359997 23670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:17.369513 23670 catalog_manager.cc:1347] Generated new cluster ID: e8b9166fc3cf4328a7c597d8b70c095c
I20260811 07:38:17.369673 23670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:17.381135 23670 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:17.381932 23670 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:17.408296 23670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P da3184f2fc984cb4b82eb383a93cb93c: Generated new TSK 0
I20260811 07:38:17.409595 23670 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:17.419092 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23524
2026-08-11T07:38:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2034 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:17 dist-test-slave-7z32 krb5kdc[23690](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:17 dist-test-slave-7z32 krb5kdc[23690](info): set up 2 sockets
Aug 11 07:38:17 dist-test-slave-7z32 krb5kdc[23690](info): commencing operation
krb5kdc: starting...
W20260811 07:38:18.884928 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.415s user 0.001s sys 0.010s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:19 dist-test-slave-7z32 krb5kdc[23690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:38:19.069201 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:45697
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:43729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:45697
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:19.247526 23713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:19.248466 23713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:19.248586 23713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:19.254009 23713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:19.254156 23713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:19.254180 23713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:19.254200 23713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:19.254218 23713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:19.263067 23713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:43729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:45697
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:45697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:19.264916 23713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:19.267120 23713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:19.280112 23721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:19.280102 23723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:19.280143 23725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:19.280458 23713 server_base.cc:1034] running on GCE node
I20260811 07:38:19.281515 23713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:19.283427 23713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:19.284726 23713 hybrid_clock.cc:648] HybridClock initialized: now 1786433899284678 us; error 74 us; skew 500 ppm
Aug 11 07:38:19 dist-test-slave-7z32 krb5kdc[23690](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433899, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:19.294459 23713 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:38:19.296401 23713 webserver.cc:460] Webserver started at http://127.22.4.254:44265/ using document root <none> and password file <none>
I20260811 07:38:19.297675 23713 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:19.297852 23713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:19.298228 23713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:19.301515 23713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "229fe0a418c44c0ea39fb1c615df21b3"
format_stamp: "Formatted at 2026-08-11 07:38:19 on dist-test-slave-7z32"
server_key: "9c99df2fe7c1290345ba5303f1eedd1d"
server_key_iv: "058ac78ed0b2ff762ecec987cf4aa2ee"
server_key_version: "encryptionkey@0"
I20260811 07:38:19.302428 23713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "229fe0a418c44c0ea39fb1c615df21b3"
format_stamp: "Formatted at 2026-08-11 07:38:19 on dist-test-slave-7z32"
server_key: "9c99df2fe7c1290345ba5303f1eedd1d"
server_key_iv: "058ac78ed0b2ff762ecec987cf4aa2ee"
server_key_version: "encryptionkey@0"
I20260811 07:38:19.308946 23713 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s
I20260811 07:38:19.313602 23740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:19.316125 23713 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.002s sys 0.000s
I20260811 07:38:19.316416 23713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "229fe0a418c44c0ea39fb1c615df21b3"
format_stamp: "Formatted at 2026-08-11 07:38:19 on dist-test-slave-7z32"
server_key: "9c99df2fe7c1290345ba5303f1eedd1d"
server_key_iv: "058ac78ed0b2ff762ecec987cf4aa2ee"
server_key_version: "encryptionkey@0"
I20260811 07:38:19.316639 23713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:19.338697 23713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:19.343511 23713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:19.344041 23713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:19.355151 23713 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:45697
I20260811 07:38:19.355244 23816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:45697 every 8 connection(s)
I20260811 07:38:19.356642 23713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:19.360517 23817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:19.364405 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23713
I20260811 07:38:19.364591 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:19.364912 22547 external_mini_cluster.cc:1428] Setting key b6b3f505cdeb03296f907929dbc4f737
I20260811 07:38:19.368373 23817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3: Bootstrap starting.
I20260811 07:38:19.372274 23817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:19.373677 23817 log.cc:824] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:38:19 dist-test-slave-7z32 krb5kdc[23690](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433899, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:38:19.379508 23817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3: No bootstrap required, opened a new log
I20260811 07:38:19.385627 23817 raft_consensus.cc:348] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229fe0a418c44c0ea39fb1c615df21b3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 45697 } }
I20260811 07:38:19.386317 23817 raft_consensus.cc:374] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:19.386651 23817 raft_consensus.cc:729] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 229fe0a418c44c0ea39fb1c615df21b3, State: Initialized, Role: FOLLOWER
I20260811 07:38:19.387604 23817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229fe0a418c44c0ea39fb1c615df21b3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 45697 } }
I20260811 07:38:19.387827 23817 raft_consensus.cc:388] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:19.387917 23817 raft_consensus.cc:482] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:19.388044 23817 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:19.388733 23821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:19.367135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49373 (local address 127.22.4.254:45697)
0811 07:38:19.367846 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:19.367869 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:19.367926 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:38:19.368961 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:19.368992 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:19.369656 (+ 664us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:19.370124 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:19.371574 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:19.373255 (+ 1681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:19.374698 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:19.375400 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:19.375890 (+ 490us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:19.380520 (+ 4630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:19.380528 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:19.380553 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:19.380601 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:19.383034 (+ 2433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:19.384122 (+ 1088us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:19.384131 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:19.384139 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:19.384337 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:19.384889 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:19.384893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:19.384895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:19.385559 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:19.385919 (+ 360us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:19.386655 (+ 736us) server_negotiation.cc:299] Negotiation successful
0811 07:38:19.387327 (+ 672us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":250,"threads_started":1}
I20260811 07:38:19.389683 23817 raft_consensus.cc:504] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229fe0a418c44c0ea39fb1c615df21b3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 45697 } }
I20260811 07:38:19.390311 23817 leader_election.cc:302] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 229fe0a418c44c0ea39fb1c615df21b3; no voters:
I20260811 07:38:19.390915 23817 leader_election.cc:288] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:19.391220 23824 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:19.391635 23824 raft_consensus.cc:686] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [term 1 LEADER]: Becoming Leader. State: Replica: 229fe0a418c44c0ea39fb1c615df21b3, State: Running, Role: LEADER
I20260811 07:38:19.392282 23824 consensus_queue.cc:237] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229fe0a418c44c0ea39fb1c615df21b3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 45697 } }
I20260811 07:38:19.393028 23817 sys_catalog.cc:564] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:19.393890 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:19.394647 23826 sys_catalog.cc:455] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 229fe0a418c44c0ea39fb1c615df21b3. Latest consensus state: current_term: 1 leader_uuid: "229fe0a418c44c0ea39fb1c615df21b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229fe0a418c44c0ea39fb1c615df21b3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 45697 } } }
I20260811 07:38:19.394945 23826 sys_catalog.cc:458] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:19.395638 23825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "229fe0a418c44c0ea39fb1c615df21b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "229fe0a418c44c0ea39fb1c615df21b3" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 45697 } } }
I20260811 07:38:19.395866 23825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:19.395835 23837 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:19.401748 23837 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:19.410988 23837 catalog_manager.cc:1347] Generated new cluster ID: 761fb4cd7d8d418ba166eb0ed9186577
I20260811 07:38:19.411087 23837 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:19.413394 23821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:19.397059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43885 (local address 127.22.4.254:45697)
0811 07:38:19.397475 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:19.397481 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:19.398268 (+ 787us) server_negotiation.cc:407] Connection header received
0811 07:38:19.398783 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:19.398786 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:19.398906 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:19.399133 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:19.400549 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:19.401610 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:19.403763 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:19.404230 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:19.404358 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:19.407376 (+ 3018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:19.407382 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:19.407385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:19.407443 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:19.409718 (+ 2275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:19.410643 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:19.410648 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:19.410651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:19.410796 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:19.411436 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:19.411442 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:19.411443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:19.412086 (+ 643us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:19.412557 (+ 471us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:19.413053 (+ 496us) server_negotiation.cc:299] Negotiation successful
0811 07:38:19.413199 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:38:19.423444 23837 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:19.425467 23837 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:19.438109 23837 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 229fe0a418c44c0ea39fb1c615df21b3: Generated new TSK 0
I20260811 07:38:19.439632 23837 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:19.453019 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23713
W20260811 07:38:19.481249 23687 connection.cc:535] client connection to 127.22.4.254:45697 recv error: Network error: failed to read from TLS socket (remote: 127.22.4.254:45697): Connection reset by peer (error 104)
2026-08-11T07:38:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2027 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:19 dist-test-slave-7z32 krb5kdc[23866](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:19 dist-test-slave-7z32 krb5kdc[23866](info): set up 2 sockets
Aug 11 07:38:19 dist-test-slave-7z32 krb5kdc[23866](info): commencing operation
krb5kdc: starting...
W20260811 07:38:20.856966 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.358s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:20 dist-test-slave-7z32 krb5kdc[23866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:38:21.039489 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42779
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:34141
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:42779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:21.207129 23891 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:21.207597 23891 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:21.207651 23891 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:21.212615 23891 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:21.212744 23891 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:21.212766 23891 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:21.212786 23891 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:21.212802 23891 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:21.219820 23891 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:34141
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:42779
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23891
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:21.222620 23891 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:21.224939 23891 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:21.239167 23900 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:21.239133 23908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:21.239244 23891 server_base.cc:1034] running on GCE node
W20260811 07:38:21.239145 23903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:21.240341 23891 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:21.242486 23891 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:21.245980 23891 hybrid_clock.cc:648] HybridClock initialized: now 1786433901245884 us; error 93 us; skew 500 ppm
Aug 11 07:38:21 dist-test-slave-7z32 krb5kdc[23866](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433901, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:21.250792 23891 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:38:21.252935 23891 webserver.cc:460] Webserver started at http://127.22.4.254:34301/ using document root <none> and password file <none>
I20260811 07:38:21.253885 23891 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:21.254019 23891 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:21.254369 23891 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:21.258409 23891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "b78d344668874b3e9b97fca2571d2f43"
format_stamp: "Formatted at 2026-08-11 07:38:21 on dist-test-slave-7z32"
server_key: "4e3d774ff4cf0956bef3df55f693f01c"
server_key_iv: "ec0aae027d51df316d3d33a907c873d3"
server_key_version: "encryptionkey@0"
I20260811 07:38:21.259415 23891 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "b78d344668874b3e9b97fca2571d2f43"
format_stamp: "Formatted at 2026-08-11 07:38:21 on dist-test-slave-7z32"
server_key: "4e3d774ff4cf0956bef3df55f693f01c"
server_key_iv: "ec0aae027d51df316d3d33a907c873d3"
server_key_version: "encryptionkey@0"
I20260811 07:38:21.265551 23891 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260811 07:38:21.269620 23922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:21.271847 23891 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:38:21.272049 23891 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b78d344668874b3e9b97fca2571d2f43"
format_stamp: "Formatted at 2026-08-11 07:38:21 on dist-test-slave-7z32"
server_key: "4e3d774ff4cf0956bef3df55f693f01c"
server_key_iv: "ec0aae027d51df316d3d33a907c873d3"
server_key_version: "encryptionkey@0"
I20260811 07:38:21.272210 23891 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:21.305164 23891 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:21.310392 23891 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:21.310676 23891 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:21.325090 23891 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:42779
I20260811 07:38:21.325117 24005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:42779 every 8 connection(s)
I20260811 07:38:21.326864 23891 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:21.331332 24006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:21.333421 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 23891
I20260811 07:38:21.333607 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:21.333971 22547 external_mini_cluster.cc:1428] Setting key 64175d65dee5237c94d9f57fdcb9da36
I20260811 07:38:21.339632 24006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43: Bootstrap starting.
I20260811 07:38:21.343051 24006 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:21.344162 24006 log.cc:824] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:21.348802 24006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43: No bootstrap required, opened a new log
I20260811 07:38:21.350910 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:21.336566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42303 (local address 127.22.4.254:42779)
0811 07:38:21.337395 (+ 829us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:21.337433 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:21.337498 (+ 65us) server_negotiation.cc:407] Connection header received
0811 07:38:21.338704 (+ 1206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:21.338734 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:21.339355 (+ 621us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:21.340429 (+ 1074us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:21.341116 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:21.342698 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:21.344618 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:21.345744 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:21.346145 (+ 401us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:21.348171 (+ 2026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:21.348181 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:21.348204 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:21.348889 (+ 685us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:21.348997 (+ 108us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:21.349041 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:21.349247 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:21.349541 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 07:38:21.349721 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":217,"threads_started":1}
I20260811 07:38:21.354326 24006 raft_consensus.cc:348] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d344668874b3e9b97fca2571d2f43" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42779 } }
I20260811 07:38:21.354655 24006 raft_consensus.cc:374] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:21.354727 24006 raft_consensus.cc:729] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b78d344668874b3e9b97fca2571d2f43, State: Initialized, Role: FOLLOWER
I20260811 07:38:21.355370 24006 consensus_queue.cc:260] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d344668874b3e9b97fca2571d2f43" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42779 } }
I20260811 07:38:21.355540 24006 raft_consensus.cc:388] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:21.355623 24006 raft_consensus.cc:482] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:21.355818 24006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:21.356081 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:21.357156 24006 raft_consensus.cc:504] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d344668874b3e9b97fca2571d2f43" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42779 } }
I20260811 07:38:21.357630 24006 leader_election.cc:302] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b78d344668874b3e9b97fca2571d2f43; no voters:
I20260811 07:38:21.358189 24006 leader_election.cc:288] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:21.358439 24018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:21.358783 24018 raft_consensus.cc:686] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [term 1 LEADER]: Becoming Leader. State: Replica: b78d344668874b3e9b97fca2571d2f43, State: Running, Role: LEADER
I20260811 07:38:21.360186 24006 sys_catalog.cc:564] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:21.360137 24018 consensus_queue.cc:237] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d344668874b3e9b97fca2571d2f43" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42779 } }
I20260811 07:38:21.362726 24020 sys_catalog.cc:455] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b78d344668874b3e9b97fca2571d2f43. Latest consensus state: current_term: 1 leader_uuid: "b78d344668874b3e9b97fca2571d2f43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d344668874b3e9b97fca2571d2f43" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42779 } } }
I20260811 07:38:21.363464 24020 sys_catalog.cc:458] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:21.363972 24019 sys_catalog.cc:455] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b78d344668874b3e9b97fca2571d2f43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b78d344668874b3e9b97fca2571d2f43" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42779 } } }
I20260811 07:38:21.364192 24019 sys_catalog.cc:458] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:21.366672 24012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:21.359330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47685 (local address 127.22.4.254:42779)
0811 07:38:21.359494 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:21.359500 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:21.359748 (+ 248us) server_negotiation.cc:407] Connection header received
0811 07:38:21.360026 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:21.360030 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:21.360095 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:21.360158 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:21.360736 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:21.361816 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:21.363714 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:21.364084 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:21.364211 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:21.365774 (+ 1563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:21.365779 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:21.365781 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:21.365803 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:21.365843 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:21.365858 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:21.365951 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:21.366479 (+ 528us) server_negotiation.cc:299] Negotiation successful
0811 07:38:21.366535 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 07:38:21.367230 24043 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:21.367381 24043 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:21.367499 24044 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:21.368834 24044 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:21.377810 24044 catalog_manager.cc:1347] Generated new cluster ID: eb0f501cb4084024abea22d33cf58b69
I20260811 07:38:21.377957 24044 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:21.390733 24044 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:21.392238 24044 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:21.403481 24044 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b78d344668874b3e9b97fca2571d2f43: Generated new TSK 0
I20260811 07:38:21.404768 24044 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:21.412801 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 23891
W20260811 07:38:21.433872 23864 connection.cc:535] client connection to 127.22.4.254:42779 recv error: Network error: failed to read from TLS socket (remote: 127.22.4.254:42779): Connection reset by peer (error 104)
2026-08-11T07:38:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1952 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:21 dist-test-slave-7z32 krb5kdc[24051](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:21 dist-test-slave-7z32 krb5kdc[24051](info): set up 2 sockets
Aug 11 07:38:21 dist-test-slave-7z32 krb5kdc[24051](info): commencing operation
krb5kdc: starting...
W20260811 07:38:22.839126 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.389s user 0.004s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:22 dist-test-slave-7z32 krb5kdc[24051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433902, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:38:23.020701 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:41347
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39007
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:41347
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:23.163945 24069 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:23.164350 24069 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:23.164438 24069 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:23.168916 24069 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:23.169049 24069 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:23.169086 24069 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:23.169128 24069 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:23.169163 24069 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:23.175951 24069 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39007
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:41347
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:41347
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24069
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:23.177361 24069 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:23.178650 24069 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:23.190644 24079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:23.190691 24082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:23.190752 24076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:23.191001 24069 server_base.cc:1034] running on GCE node
I20260811 07:38:23.191728 24069 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:23.193099 24069 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:23.194473 24069 hybrid_clock.cc:648] HybridClock initialized: now 1786433903194432 us; error 58 us; skew 500 ppm
Aug 11 07:38:23 dist-test-slave-7z32 krb5kdc[24051](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433903, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:23.198190 24069 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:38:23.199568 24069 webserver.cc:460] Webserver started at http://127.22.4.254:40891/ using document root <none> and password file <none>
I20260811 07:38:23.200296 24069 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:23.200402 24069 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:23.200651 24069 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:23.203096 24069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "01dabb1ea89f496088223d8a5157eee1"
format_stamp: "Formatted at 2026-08-11 07:38:23 on dist-test-slave-7z32"
server_key: "85ac74fe513dedc548e4e35ac68d9765"
server_key_iv: "dae8eef7ae107c5c83371b9d94fc4b59"
server_key_version: "encryptionkey@0"
I20260811 07:38:23.203792 24069 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "01dabb1ea89f496088223d8a5157eee1"
format_stamp: "Formatted at 2026-08-11 07:38:23 on dist-test-slave-7z32"
server_key: "85ac74fe513dedc548e4e35ac68d9765"
server_key_iv: "dae8eef7ae107c5c83371b9d94fc4b59"
server_key_version: "encryptionkey@0"
I20260811 07:38:23.208629 24069 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260811 07:38:23.212186 24093 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:23.214299 24069 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:38:23.214537 24069 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "01dabb1ea89f496088223d8a5157eee1"
format_stamp: "Formatted at 2026-08-11 07:38:23 on dist-test-slave-7z32"
server_key: "85ac74fe513dedc548e4e35ac68d9765"
server_key_iv: "dae8eef7ae107c5c83371b9d94fc4b59"
server_key_version: "encryptionkey@0"
I20260811 07:38:23.214715 24069 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:23.221304 24069 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:23.225596 24069 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:23.225852 24069 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:23.235880 24069 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:41347
I20260811 07:38:23.235997 24183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:41347 every 8 connection(s)
I20260811 07:38:23.237473 24069 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:23.241820 24184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:23.244370 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24069
I20260811 07:38:23.244608 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:23.244954 22547 external_mini_cluster.cc:1428] Setting key af865ed47b17c7ef62cec970eca7bd4f
I20260811 07:38:23.251716 24184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1: Bootstrap starting.
I20260811 07:38:23.252595 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:23.246926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38505 (local address 127.22.4.254:41347)
0811 07:38:23.247727 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:23.247752 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:23.247809 (+ 57us) server_negotiation.cc:407] Connection header received
0811 07:38:23.248835 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:23.248861 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:23.249331 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:23.249819 (+ 488us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:23.250805 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:23.250811 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:23.250877 (+ 66us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:23.250893 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:23.250977 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:23.251002 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:23.251201 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:23.251284 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 07:38:23.251492 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":540,"thread_start_us":224,"threads_started":1}
I20260811 07:38:23.255447 24184 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:23.256613 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:23.256664 24184 log.cc:824] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:23.260317 24184 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1: No bootstrap required, opened a new log
I20260811 07:38:23.261145 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:23.259379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40763 (local address 127.22.4.254:41347)
0811 07:38:23.259561 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:23.259568 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:23.259591 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:38:23.259644 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:23.259646 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:23.259682 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:23.259772 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:23.260716 (+ 944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:23.260726 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:23.260728 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:23.260739 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:23.260765 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:23.260776 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:23.260918 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:23.260952 (+ 34us) server_negotiation.cc:299] Negotiation successful
0811 07:38:23.260992 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:38:23.265997 24184 raft_consensus.cc:348] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01dabb1ea89f496088223d8a5157eee1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41347 } }
I20260811 07:38:23.266474 24184 raft_consensus.cc:374] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:23.266538 24184 raft_consensus.cc:729] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 01dabb1ea89f496088223d8a5157eee1, State: Initialized, Role: FOLLOWER
I20260811 07:38:23.267275 24184 consensus_queue.cc:260] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01dabb1ea89f496088223d8a5157eee1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41347 } }
I20260811 07:38:23.267457 24184 raft_consensus.cc:388] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:23.267513 24184 raft_consensus.cc:482] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:23.267612 24184 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:23.268937 24184 raft_consensus.cc:504] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01dabb1ea89f496088223d8a5157eee1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41347 } }
I20260811 07:38:23.269397 24184 leader_election.cc:302] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 01dabb1ea89f496088223d8a5157eee1; no voters:
I20260811 07:38:23.269934 24184 leader_election.cc:288] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:23.270187 24201 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:23.270705 24201 raft_consensus.cc:686] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [term 1 LEADER]: Becoming Leader. State: Replica: 01dabb1ea89f496088223d8a5157eee1, State: Running, Role: LEADER
I20260811 07:38:23.271266 24201 consensus_queue.cc:237] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01dabb1ea89f496088223d8a5157eee1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41347 } }
I20260811 07:38:23.272035 24184 sys_catalog.cc:564] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:23.273819 24204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 01dabb1ea89f496088223d8a5157eee1. Latest consensus state: current_term: 1 leader_uuid: "01dabb1ea89f496088223d8a5157eee1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01dabb1ea89f496088223d8a5157eee1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41347 } } }
I20260811 07:38:23.273895 24203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "01dabb1ea89f496088223d8a5157eee1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "01dabb1ea89f496088223d8a5157eee1" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 41347 } } }
I20260811 07:38:23.274142 24204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:23.274174 24203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:23.275014 24218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:23.278944 24218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:23.285599 24218 catalog_manager.cc:1347] Generated new cluster ID: 7ac3f946703b46e489b6d2d9d4db4af6
I20260811 07:38:23.285718 24218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:23.297200 24218 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:23.298203 24218 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:23.306051 24218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 01dabb1ea89f496088223d8a5157eee1: Generated new TSK 0
I20260811 07:38:23.307422 24218 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:23.321522 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24069
2026-08-11T07:38:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1904 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:23 dist-test-slave-7z32 krb5kdc[24229](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:23 dist-test-slave-7z32 krb5kdc[24229](info): set up 2 sockets
Aug 11 07:38:23 dist-test-slave-7z32 krb5kdc[24229](info): commencing operation
krb5kdc: starting...
W20260811 07:38:24.741696 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.386s user 0.005s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:24 dist-test-slave-7z32 krb5kdc[24229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:38:24.945148 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:44969
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:45779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:44969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:25.105120 24246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:25.106262 24246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:25.106359 24246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:25.112121 24246 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:25.112275 24246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:25.112298 24246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:25.112319 24246 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:25.112336 24246 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:25.119367 24246 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:45779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:44969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:44969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:25.121028 24246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:25.123399 24246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:25.136543 24252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:25.136662 24251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:25.136776 24254 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:25.136626 24246 server_base.cc:1034] running on GCE node
I20260811 07:38:25.138041 24246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:25.139981 24246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:25.141270 24246 hybrid_clock.cc:648] HybridClock initialized: now 1786433905141231 us; error 69 us; skew 500 ppm
Aug 11 07:38:25 dist-test-slave-7z32 krb5kdc[24229](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433905, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:25.145422 24246 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:38:25.146972 24246 webserver.cc:460] Webserver started at http://127.22.4.254:37903/ using document root <none> and password file <none>
I20260811 07:38:25.147764 24246 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:25.147843 24246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:25.148077 24246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:25.151101 24246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "b80a95501a7e4f4b9a10ac8239717e1b"
format_stamp: "Formatted at 2026-08-11 07:38:25 on dist-test-slave-7z32"
server_key: "f855c43d6db6e1d09d7efb2c81939e64"
server_key_iv: "3a27aac4c6418107d95a892dea0ff3d0"
server_key_version: "encryptionkey@0"
I20260811 07:38:25.151873 24246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "b80a95501a7e4f4b9a10ac8239717e1b"
format_stamp: "Formatted at 2026-08-11 07:38:25 on dist-test-slave-7z32"
server_key: "f855c43d6db6e1d09d7efb2c81939e64"
server_key_iv: "3a27aac4c6418107d95a892dea0ff3d0"
server_key_version: "encryptionkey@0"
I20260811 07:38:25.157524 24246 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:38:25.161428 24270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:25.163805 24246 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260811 07:38:25.164026 24246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "b80a95501a7e4f4b9a10ac8239717e1b"
format_stamp: "Formatted at 2026-08-11 07:38:25 on dist-test-slave-7z32"
server_key: "f855c43d6db6e1d09d7efb2c81939e64"
server_key_iv: "3a27aac4c6418107d95a892dea0ff3d0"
server_key_version: "encryptionkey@0"
I20260811 07:38:25.164196 24246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:25.197677 24246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:25.203899 24246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:25.204217 24246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:25.215667 24246 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:44969
I20260811 07:38:25.215720 24353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:44969 every 8 connection(s)
I20260811 07:38:25.217166 24246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:25.220288 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24246
I20260811 07:38:25.220489 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:25.220868 22547 external_mini_cluster.cc:1428] Setting key d27fee17479ccbfab754d106abb9b44e
I20260811 07:38:25.221424 24355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:25.229877 24355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b: Bootstrap starting.
I20260811 07:38:25.232875 24355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:25.233783 24355 log.cc:824] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b: Log is configured to *not* fsync() on all Append() calls
Aug 11 07:38:25 dist-test-slave-7z32 krb5kdc[24229](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:38:25.237253 24355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b: No bootstrap required, opened a new log
I20260811 07:38:25.242107 24355 raft_consensus.cc:348] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80a95501a7e4f4b9a10ac8239717e1b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44969 } }
I20260811 07:38:25.242439 24355 raft_consensus.cc:374] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:25.242533 24355 raft_consensus.cc:729] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b80a95501a7e4f4b9a10ac8239717e1b, State: Initialized, Role: FOLLOWER
I20260811 07:38:25.242718 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:25.223091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54609 (local address 127.22.4.254:44969)
0811 07:38:25.223848 (+ 757us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:25.223874 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:25.223934 (+ 60us) server_negotiation.cc:407] Connection header received
0811 07:38:25.225088 (+ 1154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:25.225157 (+ 69us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:25.225758 (+ 601us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:25.226340 (+ 582us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:25.227651 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:25.229060 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:25.230241 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:25.230980 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:25.231207 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:25.235263 (+ 4056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:25.235277 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:25.235315 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:25.235365 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:25.237868 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:25.238728 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:25.238736 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:25.238976 (+ 240us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:25.239225 (+ 249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:25.239683 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:25.239687 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:25.239689 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:25.240363 (+ 674us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:25.240680 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:25.240968 (+ 288us) server_negotiation.cc:299] Negotiation successful
0811 07:38:25.241474 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":223,"threads_started":1}
I20260811 07:38:25.243239 24355 consensus_queue.cc:260] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80a95501a7e4f4b9a10ac8239717e1b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44969 } }
I20260811 07:38:25.243436 24355 raft_consensus.cc:388] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:25.243551 24355 raft_consensus.cc:482] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:25.243716 24355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:25.245129 24355 raft_consensus.cc:504] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80a95501a7e4f4b9a10ac8239717e1b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44969 } }
I20260811 07:38:25.245573 24355 leader_election.cc:302] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b80a95501a7e4f4b9a10ac8239717e1b; no voters:
I20260811 07:38:25.246186 24355 leader_election.cc:288] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:25.246297 24365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:25.246524 24365 raft_consensus.cc:686] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [term 1 LEADER]: Becoming Leader. State: Replica: b80a95501a7e4f4b9a10ac8239717e1b, State: Running, Role: LEADER
I20260811 07:38:25.247651 24365 consensus_queue.cc:237] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80a95501a7e4f4b9a10ac8239717e1b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44969 } }
I20260811 07:38:25.247723 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:25.248045 24355 sys_catalog.cc:564] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:25.251868 24367 sys_catalog.cc:455] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b80a95501a7e4f4b9a10ac8239717e1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80a95501a7e4f4b9a10ac8239717e1b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44969 } } }
I20260811 07:38:25.251834 24368 sys_catalog.cc:455] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b80a95501a7e4f4b9a10ac8239717e1b. Latest consensus state: current_term: 1 leader_uuid: "b80a95501a7e4f4b9a10ac8239717e1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b80a95501a7e4f4b9a10ac8239717e1b" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 44969 } } }
I20260811 07:38:25.252141 24368 sys_catalog.cc:458] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:25.252485 24367 sys_catalog.cc:458] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b [sys.catalog]: This master's current role is: LEADER
W20260811 07:38:25.255488 24389 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:25.255772 24389 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:25.256067 24392 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:25.257431 24392 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:25.260887 24359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:25.251372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55049 (local address 127.22.4.254:44969)
0811 07:38:25.251559 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:25.251566 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:25.252268 (+ 702us) server_negotiation.cc:407] Connection header received
0811 07:38:25.252513 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:25.252517 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:25.252582 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:25.252642 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:25.253521 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:25.254157 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:25.255141 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:25.255474 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:25.255575 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:25.257229 (+ 1654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:25.257234 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:25.257237 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:25.257271 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:25.258976 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:25.259425 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:25.259429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:25.259431 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:25.259518 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:25.259804 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:25.259811 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:25.259813 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:25.260028 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:25.260185 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:25.260428 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 07:38:25.260562 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260811 07:38:25.265961 24392 catalog_manager.cc:1347] Generated new cluster ID: e181be8992ed40d594fc29a2b24631bf
I20260811 07:38:25.266151 24392 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:25.292692 24392 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:25.293949 24392 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:25.303805 24392 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b80a95501a7e4f4b9a10ac8239717e1b: Generated new TSK 0
I20260811 07:38:25.304926 24392 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:25.320804 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24246
2026-08-11T07:38:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2001 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:25 dist-test-slave-7z32 krb5kdc[24398](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:25 dist-test-slave-7z32 krb5kdc[24398](info): set up 2 sockets
Aug 11 07:38:25 dist-test-slave-7z32 krb5kdc[24398](info): commencing operation
krb5kdc: starting...
W20260811 07:38:26.789189 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.433s user 0.000s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:26 dist-test-slave-7z32 krb5kdc[24398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:38:26.977799 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42441
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:39105
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:42441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:27.148770 24416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:27.149219 24416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:27.149310 24416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:27.153898 24416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:27.154062 24416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:27.154111 24416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:27.154150 24416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:27.154211 24416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:27.160887 24416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:39105
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:42441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:27.162611 24416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:27.164222 24416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:27.177970 24426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:27.177954 24425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:27.178438 24416 server_base.cc:1034] running on GCE node
W20260811 07:38:27.177954 24429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:27.179780 24416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:27.181839 24416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:27.183238 24416 hybrid_clock.cc:648] HybridClock initialized: now 1786433907183156 us; error 123 us; skew 500 ppm
Aug 11 07:38:27 dist-test-slave-7z32 krb5kdc[24398](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433907, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:27.188202 24416 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:38:27.190402 24416 webserver.cc:460] Webserver started at http://127.22.4.254:33205/ using document root <none> and password file <none>
I20260811 07:38:27.191705 24416 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:27.191885 24416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:27.192536 24416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:27.196369 24416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "7f9a9765a08d452793261768d446310a"
format_stamp: "Formatted at 2026-08-11 07:38:27 on dist-test-slave-7z32"
server_key: "01a0688de61ec2272efcadda6dd28122"
server_key_iv: "0d982855408b43b82dc4c91c06a6fe17"
server_key_version: "encryptionkey@0"
I20260811 07:38:27.197371 24416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "7f9a9765a08d452793261768d446310a"
format_stamp: "Formatted at 2026-08-11 07:38:27 on dist-test-slave-7z32"
server_key: "01a0688de61ec2272efcadda6dd28122"
server_key_iv: "0d982855408b43b82dc4c91c06a6fe17"
server_key_version: "encryptionkey@0"
I20260811 07:38:27.207389 24416 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.011s sys 0.000s
I20260811 07:38:27.212590 24444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:27.215199 24416 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:38:27.215507 24416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "7f9a9765a08d452793261768d446310a"
format_stamp: "Formatted at 2026-08-11 07:38:27 on dist-test-slave-7z32"
server_key: "01a0688de61ec2272efcadda6dd28122"
server_key_iv: "0d982855408b43b82dc4c91c06a6fe17"
server_key_version: "encryptionkey@0"
I20260811 07:38:27.215742 24416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:27.246394 24416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:27.252897 24416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:27.253394 24416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:27.267607 24416 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:42441
I20260811 07:38:27.267684 24529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:42441 every 8 connection(s)
I20260811 07:38:27.269454 24416 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:27.273995 24530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:27.274164 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24416
I20260811 07:38:27.274425 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:27.275204 22547 external_mini_cluster.cc:1428] Setting key 2b8a42a7cc34e80d04d687f047f8ab08
I20260811 07:38:27.283118 24530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a: Bootstrap starting.
I20260811 07:38:27.286685 24530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:27.287688 24530 log.cc:824] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:27.289999 24533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:27.277449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43285 (local address 127.22.4.254:42441)
0811 07:38:27.278180 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:27.278205 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:27.278282 (+ 77us) server_negotiation.cc:407] Connection header received
0811 07:38:27.279391 (+ 1109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:27.279425 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:27.280024 (+ 599us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:27.280511 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:27.281284 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:27.282816 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:27.284697 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:27.285453 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:27.285734 (+ 281us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:27.286968 (+ 1234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:27.286983 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:27.287008 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:27.287700 (+ 692us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:27.287799 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:27.287873 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:27.288018 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:27.288370 (+ 352us) server_negotiation.cc:299] Negotiation successful
0811 07:38:27.288740 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":230,"threads_started":1}
I20260811 07:38:27.291111 24530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a: No bootstrap required, opened a new log
I20260811 07:38:27.294938 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:27.295814 24530 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f9a9765a08d452793261768d446310a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42441 } }
I20260811 07:38:27.296114 24530 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:27.296151 24530 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9a9765a08d452793261768d446310a, State: Initialized, Role: FOLLOWER
I20260811 07:38:27.296657 24530 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f9a9765a08d452793261768d446310a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42441 } }
I20260811 07:38:27.296833 24530 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:27.296914 24530 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:27.297034 24530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:27.298372 24530 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f9a9765a08d452793261768d446310a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42441 } }
I20260811 07:38:27.298900 24530 leader_election.cc:302] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f9a9765a08d452793261768d446310a; no voters:
I20260811 07:38:27.299348 24530 leader_election.cc:288] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:27.299513 24552 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:27.299731 24552 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [term 1 LEADER]: Becoming Leader. State: Replica: 7f9a9765a08d452793261768d446310a, State: Running, Role: LEADER
I20260811 07:38:27.300092 24552 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f9a9765a08d452793261768d446310a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42441 } }
I20260811 07:38:27.301339 24530 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:27.301975 24554 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f9a9765a08d452793261768d446310a. Latest consensus state: current_term: 1 leader_uuid: "7f9a9765a08d452793261768d446310a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f9a9765a08d452793261768d446310a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42441 } } }
I20260811 07:38:27.302131 24554 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:27.302577 24557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f9a9765a08d452793261768d446310a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f9a9765a08d452793261768d446310a" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42441 } } }
I20260811 07:38:27.302778 24557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:27.304986 24533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:27.298583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37999 (local address 127.22.4.254:42441)
0811 07:38:27.298800 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:27.298805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:27.299244 (+ 439us) server_negotiation.cc:407] Connection header received
0811 07:38:27.299469 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:27.299473 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:27.299542 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:27.299653 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:27.300195 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:27.301068 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:27.302315 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:27.302778 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:27.302940 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:27.304138 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:27.304142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:27.304145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:27.304164 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:27.304207 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:27.304220 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:27.304322 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:27.304740 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 07:38:27.304820 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
W20260811 07:38:27.309136 24575 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:27.309278 24575 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:27.309374 24559 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:27.310344 24559 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:27.318933 24559 catalog_manager.cc:1347] Generated new cluster ID: 5e5690bf366e433aa2830f8ea922c63a
I20260811 07:38:27.319087 24559 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:27.327382 24559 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:27.329113 24559 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:27.335922 24559 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f9a9765a08d452793261768d446310a: Generated new TSK 0
I20260811 07:38:27.337283 24559 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:27.353277 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24416
2026-08-11T07:38:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2032 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:27 dist-test-slave-7z32 krb5kdc[24582](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:27 dist-test-slave-7z32 krb5kdc[24582](info): set up 2 sockets
Aug 11 07:38:27 dist-test-slave-7z32 krb5kdc[24582](info): commencing operation
krb5kdc: starting...
W20260811 07:38:28.737468 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.348s user 0.003s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:28 dist-test-slave-7z32 krb5kdc[24582](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433908, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:38:28.924628 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42181
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:44681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:42181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:29.073065 24601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:29.073539 24601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:29.073647 24601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:29.078480 24601 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:29.078588 24601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:29.078609 24601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:29.078627 24601 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:29.078644 24601 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:29.084792 24601 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:44681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:42181
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:42181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:29.086160 24601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:29.087467 24601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:29.098809 24607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:29.098954 24606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:29.098954 24610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:29.099318 24601 server_base.cc:1034] running on GCE node
I20260811 07:38:29.100353 24601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:29.101729 24601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:29.102984 24601 hybrid_clock.cc:648] HybridClock initialized: now 1786433909102959 us; error 55 us; skew 500 ppm
Aug 11 07:38:29 dist-test-slave-7z32 krb5kdc[24582](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433909, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:29.106936 24601 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:38:29.108294 24601 webserver.cc:460] Webserver started at http://127.22.4.254:33503/ using document root <none> and password file <none>
I20260811 07:38:29.109051 24601 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:29.109167 24601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:29.109458 24601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:29.112203 24601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "90f184e84ee14ed098c234f0dda94931"
format_stamp: "Formatted at 2026-08-11 07:38:29 on dist-test-slave-7z32"
server_key: "568879a8465b113d29890230ece7e2a2"
server_key_iv: "b9e07f51c446ffe56e9a82059b264d9a"
server_key_version: "encryptionkey@0"
I20260811 07:38:29.113001 24601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "90f184e84ee14ed098c234f0dda94931"
format_stamp: "Formatted at 2026-08-11 07:38:29 on dist-test-slave-7z32"
server_key: "568879a8465b113d29890230ece7e2a2"
server_key_iv: "b9e07f51c446ffe56e9a82059b264d9a"
server_key_version: "encryptionkey@0"
I20260811 07:38:29.118575 24601 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:38:29.123317 24620 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:29.125545 24601 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260811 07:38:29.125804 24601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "90f184e84ee14ed098c234f0dda94931"
format_stamp: "Formatted at 2026-08-11 07:38:29 on dist-test-slave-7z32"
server_key: "568879a8465b113d29890230ece7e2a2"
server_key_iv: "b9e07f51c446ffe56e9a82059b264d9a"
server_key_version: "encryptionkey@0"
I20260811 07:38:29.125989 24601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:29.132823 24601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:29.137611 24601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:29.137895 24601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:29.147181 24601 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:42181
I20260811 07:38:29.147308 24710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:42181 every 8 connection(s)
I20260811 07:38:29.148506 24601 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:29.153087 24715 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:29.157400 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24601
I20260811 07:38:29.157601 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:29.157984 22547 external_mini_cluster.cc:1428] Setting key 7ca253826c713b1703a3281ac6cdc888
I20260811 07:38:29.162369 24715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931: Bootstrap starting.
I20260811 07:38:29.164875 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:29.159826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46301 (local address 127.22.4.254:42181)
0811 07:38:29.160372 (+ 546us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:29.160390 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:29.160437 (+ 47us) server_negotiation.cc:407] Connection header received
0811 07:38:29.161312 (+ 875us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:29.161335 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:29.161700 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:29.162070 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:29.163301 (+ 1231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:29.163307 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:29.163321 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:29.163333 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:29.163399 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:29.163424 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:29.163583 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:29.163718 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 07:38:29.163981 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":156,"threads_started":1}
I20260811 07:38:29.166316 24715 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:29.167562 24715 log.cc:824] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:29.169565 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:29.170948 24715 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931: No bootstrap required, opened a new log
I20260811 07:38:29.174762 24725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:29.172276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38129 (local address 127.22.4.254:42181)
0811 07:38:29.172469 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:29.172477 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:29.172761 (+ 284us) server_negotiation.cc:407] Connection header received
0811 07:38:29.172921 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:29.172924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:29.172971 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:29.173078 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:29.174148 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:29.174152 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:29.174154 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 07:38:29.174167 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:29.174201 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 07:38:29.174222 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:29.174328 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:29.174507 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 07:38:29.174556 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 07:38:29.176847 24715 raft_consensus.cc:348] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f184e84ee14ed098c234f0dda94931" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42181 } }
I20260811 07:38:29.177208 24715 raft_consensus.cc:374] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 07:38:29.177248 24715 raft_consensus.cc:729] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90f184e84ee14ed098c234f0dda94931, State: Initialized, Role: FOLLOWER
I20260811 07:38:29.177975 24715 consensus_queue.cc:260] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f184e84ee14ed098c234f0dda94931" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42181 } }
I20260811 07:38:29.178177 24715 raft_consensus.cc:388] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 07:38:29.178285 24715 raft_consensus.cc:482] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 07:38:29.178411 24715 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:29.180332 24715 raft_consensus.cc:504] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f184e84ee14ed098c234f0dda94931" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42181 } }
I20260811 07:38:29.180948 24715 leader_election.cc:302] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 90f184e84ee14ed098c234f0dda94931; no voters:
I20260811 07:38:29.181511 24715 leader_election.cc:288] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 07:38:29.181954 24736 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:29.182562 24736 raft_consensus.cc:686] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [term 1 LEADER]: Becoming Leader. State: Replica: 90f184e84ee14ed098c234f0dda94931, State: Running, Role: LEADER
I20260811 07:38:29.183177 24736 consensus_queue.cc:237] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f184e84ee14ed098c234f0dda94931" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42181 } }
I20260811 07:38:29.183794 24715 sys_catalog.cc:564] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:29.185531 24738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "90f184e84ee14ed098c234f0dda94931" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f184e84ee14ed098c234f0dda94931" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42181 } } }
I20260811 07:38:29.185703 24738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:29.186008 24738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 90f184e84ee14ed098c234f0dda94931. Latest consensus state: current_term: 1 leader_uuid: "90f184e84ee14ed098c234f0dda94931" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "90f184e84ee14ed098c234f0dda94931" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 42181 } } }
I20260811 07:38:29.186105 24738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:29.186479 24750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:29.194582 24750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:29.204648 24750 catalog_manager.cc:1347] Generated new cluster ID: 268c041c8b0e40aa84e6a210dc2dc2ba
I20260811 07:38:29.204774 24750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:29.222452 24750 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:29.223187 24750 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:29.234299 24750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 90f184e84ee14ed098c234f0dda94931: Generated new TSK 0
I20260811 07:38:29.235464 24750 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 07:38:29.251555 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24601
2026-08-11T07:38:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1888 ms)
[----------] 18 tests from AuthTokenIssuingTest (35903 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:29 dist-test-slave-7z32 krb5kdc[24766](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:29 dist-test-slave-7z32 krb5kdc[24766](info): set up 2 sockets
Aug 11 07:38:29 dist-test-slave-7z32 krb5kdc[24766](info): commencing operation
krb5kdc: starting...
W20260811 07:38:30.601897 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.323s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:30 dist-test-slave-7z32 krb5kdc[24766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:38:30.776057 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34587
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34587,127.22.4.253:45485,127.22.4.252:40807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:30.916275 24785 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:38:30.916782 24785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:30.916877 24785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:30.917004 24785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:30.921695 24785 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:30.921824 24785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:30.921862 24785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:30.921900 24785 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:30.921941 24785 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:30.928081 24785 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34587,127.22.4.253:45485,127.22.4.252:40807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:34587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:30.929740 24785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:30.931124 24785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:30.942698 24790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:30.942762 24793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:30.942652 24791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:30.943094 24785 server_base.cc:1034] running on GCE node
I20260811 07:38:30.944100 24785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:30.945674 24785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:30.946982 24785 hybrid_clock.cc:648] HybridClock initialized: now 1786433910946950 us; error 54 us; skew 500 ppm
Aug 11 07:38:30 dist-test-slave-7z32 krb5kdc[24766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433910, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:30.956919 24785 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:38:30.958353 24785 webserver.cc:460] Webserver started at http://127.22.4.254:38613/ using document root <none> and password file <none>
I20260811 07:38:30.959146 24785 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:30.959225 24785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:30.959494 24785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:30.961903 24785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "19e7c30808c7487e93569d75176f7a69"
format_stamp: "Formatted at 2026-08-11 07:38:30 on dist-test-slave-7z32"
server_key: "31ac5b728e7f5cb7ee39d7943e6c1644"
server_key_iv: "9679d9682cd974e1f2b19ce7b66b1ec6"
server_key_version: "encryptionkey@0"
I20260811 07:38:30.962975 24785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "19e7c30808c7487e93569d75176f7a69"
format_stamp: "Formatted at 2026-08-11 07:38:30 on dist-test-slave-7z32"
server_key: "31ac5b728e7f5cb7ee39d7943e6c1644"
server_key_iv: "9679d9682cd974e1f2b19ce7b66b1ec6"
server_key_version: "encryptionkey@0"
I20260811 07:38:30.968750 24785 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260811 07:38:30.972371 24805 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:30.974450 24785 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260811 07:38:30.974684 24785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "19e7c30808c7487e93569d75176f7a69"
format_stamp: "Formatted at 2026-08-11 07:38:30 on dist-test-slave-7z32"
server_key: "31ac5b728e7f5cb7ee39d7943e6c1644"
server_key_iv: "9679d9682cd974e1f2b19ce7b66b1ec6"
server_key_version: "encryptionkey@0"
I20260811 07:38:30.974923 24785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:30.991362 24785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:30.995613 24785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:30.995908 24785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:31.005131 24785 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:34587
I20260811 07:38:31.005656 24887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:34587 every 8 connection(s)
I20260811 07:38:31.006414 24785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:31.009159 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24785
I20260811 07:38:31.009339 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:31.009776 22547 external_mini_cluster.cc:1428] Setting key 1b867158a455769dc413fdbe14463c6e
I20260811 07:38:31.011289 24888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:31.017482 24888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.4.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.253@KRBTEST.COM" created.
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433910, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:38:31.043087 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.021243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34587 (local address 127.0.0.1:51488)
0811 07:38:31.022201 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.022280 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.023591 (+ 1311us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.024535 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.024542 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.025135 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.025481 (+ 346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.025499 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.027346 (+ 1847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.027353 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.028468 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.028491 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.029836 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.029844 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.030068 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.031086 (+ 1018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.031128 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.033987 (+ 2859us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.037953 (+ 3966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.037977 (+ 24us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.037998 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.038564 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.039347 (+ 783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.039351 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.039354 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.039614 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.040675 (+ 1061us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.040683 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.041021 (+ 338us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.041244 (+ 223us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.041711 (+ 467us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":692,"mutex_wait_us":1,"thread_start_us":241,"threads_started":1}
I20260811 07:38:31.043093 24891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.021243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51488 (local address 127.22.4.254:34587)
0811 07:38:31.021952 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.021979 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.022437 (+ 458us) server_negotiation.cc:407] Connection header received
0811 07:38:31.024020 (+ 1583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.024026 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.024286 (+ 260us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.024534 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.025722 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.027065 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.028705 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.029527 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.029730 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.034411 (+ 4681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.034423 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.034447 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.034492 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.037660 (+ 3168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.038808 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.038900 (+ 92us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.038904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.039127 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.039798 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.039801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.039803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.040467 (+ 664us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.040705 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.041384 (+ 679us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.041978 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":302,"server-negotiator.queue_time_us":445,"thread_start_us":221,"threads_started":1}
I20260811 07:38:31.046818 24888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:38:31.048110 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.047614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49790)
0811 07:38:31.047856 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.047989 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
W20260811 07:38:31.048535 24813 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
I20260811 07:38:31.050223 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.049869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49794)
0811 07:38:31.050040 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.050127 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
W20260811 07:38:31.050683 24888 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:45485: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab.
Entry for principal kudu/127.22.4.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab.
I20260811 07:38:31.053009 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.253:45485
--webserver_interface=127.22.4.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab
--principal=kudu/127.22.4.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34587,127.22.4.253:45485,127.22.4.252:40807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:38:31.100148 24888 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } attempt: 1
I20260811 07:38:31.101485 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.101022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49800)
0811 07:38:31.101303 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.101375 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173}
I20260811 07:38:31.102353 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.102125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49816)
0811 07:38:31.102240 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.102297 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 07:38:31.102531 24888 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:45485: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
I20260811 07:38:31.170744 24888 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } attempt: 2
I20260811 07:38:31.171945 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.171609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49820)
0811 07:38:31.171783 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.171863 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
I20260811 07:38:31.173489 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.173159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49832)
0811 07:38:31.173304 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.173367 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 07:38:31.173835 24888 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:45485: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
W20260811 07:38:31.211122 24896 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:38:31.211596 24896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:31.211625 24896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:31.211764 24896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:31.217222 24896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:31.217365 24896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:31.217391 24896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:31.217417 24896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:31.217437 24896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:31.224723 24896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34587,127.22.4.253:45485,127.22.4.252:40807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab
--principal=kudu/127.22.4.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.253:45485
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.4.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:31.226516 24896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:31.228051 24896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:31.241740 24903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:31.241734 24902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:31.241802 24896 server_base.cc:1034] running on GCE node
W20260811 07:38:31.241767 24906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:31.243158 24896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:31.244872 24896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:31.246151 24896 hybrid_clock.cc:648] HybridClock initialized: now 1786433911246079 us; error 96 us; skew 500 ppm
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433911, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:31.250049 24896 init.cc:377] Logged in from keytab as kudu/127.22.4.253@KRBTEST.COM (short username kudu)
I20260811 07:38:31.251456 24896 webserver.cc:460] Webserver started at http://127.22.4.253:38289/ using document root <none> and password file <none>
I20260811 07:38:31.252185 24896 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:31.252259 24896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:31.252478 24896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:31.255398 24896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/data/instance:
uuid: "b4c562e038f345f296ec3cc3f9e16baf"
format_stamp: "Formatted at 2026-08-11 07:38:31 on dist-test-slave-7z32"
server_key: "c1b10b578bc9a98e5ef072f4b0bbb4dd"
server_key_iv: "1ad9fdd8821bba5b7b0b184d6d719bcf"
server_key_version: "encryptionkey@0"
I20260811 07:38:31.256103 24896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/wal/instance:
uuid: "b4c562e038f345f296ec3cc3f9e16baf"
format_stamp: "Formatted at 2026-08-11 07:38:31 on dist-test-slave-7z32"
server_key: "c1b10b578bc9a98e5ef072f4b0bbb4dd"
server_key_iv: "1ad9fdd8821bba5b7b0b184d6d719bcf"
server_key_version: "encryptionkey@0"
I20260811 07:38:31.261471 24896 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260811 07:38:31.265098 24888 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } attempt: 3
I20260811 07:38:31.265479 24914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:31.266337 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.265907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49848)
0811 07:38:31.266123 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.266213 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 07:38:31.267424 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.267121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49864)
0811 07:38:31.267268 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.267351 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 07:38:31.267731 24888 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:45485: Network error: Client connection negotiation failed: client connection to 127.22.4.253:45485: connect: Connection refused (error 111)
I20260811 07:38:31.267717 24896 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:38:31.268116 24896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/wal
uuid: "b4c562e038f345f296ec3cc3f9e16baf"
format_stamp: "Formatted at 2026-08-11 07:38:31 on dist-test-slave-7z32"
server_key: "c1b10b578bc9a98e5ef072f4b0bbb4dd"
server_key_iv: "1ad9fdd8821bba5b7b0b184d6d719bcf"
server_key_version: "encryptionkey@0"
I20260811 07:38:31.268286 24896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:31.291390 24896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:31.295823 24896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:31.296043 24896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:31.306679 24896 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.253:45485
I20260811 07:38:31.307199 24997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.253:45485 every 8 connection(s)
I20260811 07:38:31.308264 24896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
I20260811 07:38:31.312669 24998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:31.316900 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 24896
I20260811 07:38:31.317091 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-1/wal/instance
I20260811 07:38:31.317502 22547 external_mini_cluster.cc:1428] Setting key eb9b217da1e383a474da58de9a919ef7
I20260811 07:38:31.318574 24998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.4.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.252@KRBTEST.COM" created.
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433911, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:38:31.341662 24891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.321756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51496 (local address 127.22.4.254:34587)
0811 07:38:31.321951 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.321956 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.323391 (+ 1435us) server_negotiation.cc:407] Connection header received
0811 07:38:31.324662 (+ 1271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.324670 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.324779 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.324957 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.326899 (+ 1942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.327892 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.329648 (+ 1756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.330129 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.330312 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.336333 (+ 6021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.336337 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.336339 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.336377 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.338595 (+ 2218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.339620 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.339629 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.339633 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.339780 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.340257 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.340262 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.340263 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.340519 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.340649 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.341299 (+ 650us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.341481 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:38:31.342756 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.322390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34587 (local address 127.0.0.1:51496)
0811 07:38:31.323151 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.323217 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.324363 (+ 1146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.325399 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.325415 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.325942 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.326598 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.326617 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.328152 (+ 1535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.328156 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.329412 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.329431 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.330517 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.330523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.330740 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.331889 (+ 1149us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.331917 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.335969 (+ 4052us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.338917 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.338931 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.338970 (+ 39us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.339453 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.339904 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.339907 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.339908 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.340090 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.340648 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.340658 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.340999 (+ 341us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.341211 (+ 212us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.341703 (+ 492us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":200,"threads_started":1}
I20260811 07:38:31.345016 24998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433911, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab.
Entry for principal kudu/127.22.4.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab.
I20260811 07:38:31.359822 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.345936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49868)
0811 07:38:31.346108 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.346125 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.346247 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.347472 (+ 1225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.347476 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.347698 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.347851 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.347857 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.349318 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.349321 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.350030 (+ 709us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.350041 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.351246 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.351249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.351351 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.351990 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.352004 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.354319 (+ 2315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.356954 (+ 2635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.356958 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.356960 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.357308 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.357911 (+ 603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.357914 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.357916 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.358035 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.358920 (+ 885us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.358926 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.359070 (+ 144us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.359235 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.359511 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260811 07:38:31.359912 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.346170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49868 (local address 127.22.4.253:45485)
0811 07:38:31.346702 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.346722 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.346767 (+ 45us) server_negotiation.cc:407] Connection header received
0811 07:38:31.346873 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.346882 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.347234 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.347466 (+ 232us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.348015 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.349171 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.350214 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.351079 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.351243 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.354603 (+ 3360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.354629 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.354661 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.354709 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.356766 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.357540 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.357572 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.357577 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.357728 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.358232 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.358236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.358237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.358676 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.358811 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.359436 (+ 625us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.359681 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":162,"threads_started":1}
I20260811 07:38:31.360927 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.252:40807
--webserver_interface=127.22.4.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab
--principal=kudu/127.22.4.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:36247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:34587,127.22.4.253:45485,127.22.4.252:40807
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:38:31.362730 24998 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:38:31.364127 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.363573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59496)
0811 07:38:31.363867 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.364011 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
W20260811 07:38:31.364457 24919 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
I20260811 07:38:31.365846 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.365474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59508)
0811 07:38:31.365652 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.365737 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 07:38:31.366093 24998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:40807: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
I20260811 07:38:31.411007 24888 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } attempt: 4
I20260811 07:38:31.415445 24998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } attempt: 1
I20260811 07:38:31.416435 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.416079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59510)
0811 07:38:31.416236 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.416321 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260811 07:38:31.417572 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.417192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59512)
0811 07:38:31.417447 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.417512 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260811 07:38:31.418041 24998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:40807: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433910, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
I20260811 07:38:31.423465 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.411917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49872)
0811 07:38:31.412284 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.412307 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.412490 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.412851 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.412854 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.413136 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.413342 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.413349 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.414287 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.414291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.416266 (+ 1975us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.416283 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.417004 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.417009 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.417167 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.417984 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.417997 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.419516 (+ 1519us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.421614 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.421618 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.421621 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.421866 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.422208 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.422213 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.422215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.422308 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.422771 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.422775 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.422947 (+ 172us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.423076 (+ 129us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.423265 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199}
I20260811 07:38:31.423465 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.412154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49872 (local address 127.22.4.253:45485)
0811 07:38:31.412317 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.412322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.412484 (+ 162us) server_negotiation.cc:407] Connection header received
0811 07:38:31.412604 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.412606 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.412670 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.412798 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.413527 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.414125 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.416455 (+ 2330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.416836 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.416976 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.419700 (+ 2724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.419704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.419706 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.419731 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.421447 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.421995 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.421999 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.422001 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.422100 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.422418 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.422422 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.422424 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.422654 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.422787 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.423138 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.423270 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:38:31.425205 24888 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:38:31.426379 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.426064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59526)
0811 07:38:31.426222 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.426293 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260811 07:38:31.427384 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.427131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59532)
0811 07:38:31.427261 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.427322 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 07:38:31.427686 24888 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:40807: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
I20260811 07:38:31.486270 24998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } attempt: 2
I20260811 07:38:31.487004 24888 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } attempt: 1
I20260811 07:38:31.487540 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.487149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59534)
0811 07:38:31.487323 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.487419 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 07:38:31.488059 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.487761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59542)
0811 07:38:31.487904 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.487968 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260811 07:38:31.488921 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.488673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59546)
0811 07:38:31.488794 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.488851 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260811 07:38:31.489082 24888 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:40807: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
I20260811 07:38:31.489187 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.488792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59550)
0811 07:38:31.488938 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.489109 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260811 07:38:31.489320 24998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:40807: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
W20260811 07:38:31.532276 25010 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:38:31.532919 25010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:31.532974 25010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:31.533067 25010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:31.539211 25010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:31.539363 25010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:31.539409 25010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:31.539456 25010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:31.539494 25010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:31.546911 25010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:36247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:34587,127.22.4.253:45485,127.22.4.252:40807
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab
--principal=kudu/127.22.4.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.252:40807
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.4.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:31.548828 25010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:31.550379 25010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:38:31.556298 24888 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } attempt: 2
I20260811 07:38:31.557583 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.557143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59562)
0811 07:38:31.557374 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.557473 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260811 07:38:31.558569 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.558305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59578)
0811 07:38:31.558436 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.558496 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260811 07:38:31.558728 24888 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:40807: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
W20260811 07:38:31.563449 25017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:31.563449 25020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:31.563550 25018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:31.564002 25010 server_base.cc:1034] running on GCE node
I20260811 07:38:31.564950 25010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:31.566416 25010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:31.567647 25010 hybrid_clock.cc:648] HybridClock initialized: now 1786433911567635 us; error 68 us; skew 500 ppm
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433911, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:31.571319 25010 init.cc:377] Logged in from keytab as kudu/127.22.4.252@KRBTEST.COM (short username kudu)
I20260811 07:38:31.572592 25010 webserver.cc:460] Webserver started at http://127.22.4.252:36935/ using document root <none> and password file <none>
I20260811 07:38:31.573411 25010 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:31.573498 25010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:31.573810 25010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:31.576436 25010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/data/instance:
uuid: "0cad065372614f99838f7a74d6881c11"
format_stamp: "Formatted at 2026-08-11 07:38:31 on dist-test-slave-7z32"
server_key: "4d25bd7e0a15ad1a4bb2a74c5b11a5ad"
server_key_iv: "d36a46235110b57507d221997f2de3bb"
server_key_version: "encryptionkey@0"
I20260811 07:38:31.577111 25010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/wal/instance:
uuid: "0cad065372614f99838f7a74d6881c11"
format_stamp: "Formatted at 2026-08-11 07:38:31 on dist-test-slave-7z32"
server_key: "4d25bd7e0a15ad1a4bb2a74c5b11a5ad"
server_key_iv: "d36a46235110b57507d221997f2de3bb"
server_key_version: "encryptionkey@0"
I20260811 07:38:31.580494 24998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } attempt: 3
I20260811 07:38:31.581753 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.581253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59586)
0811 07:38:31.581576 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.581664 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154}
I20260811 07:38:31.582871 25010 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260811 07:38:31.582949 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.582512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59596)
0811 07:38:31.582742 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.582853 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
W20260811 07:38:31.583180 24998 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:40807: Network error: Client connection negotiation failed: client connection to 127.22.4.252:40807: connect: Connection refused (error 111)
I20260811 07:38:31.587121 25033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:31.589468 25010 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260811 07:38:31.589674 25010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/wal
uuid: "0cad065372614f99838f7a74d6881c11"
format_stamp: "Formatted at 2026-08-11 07:38:31 on dist-test-slave-7z32"
server_key: "4d25bd7e0a15ad1a4bb2a74c5b11a5ad"
server_key_iv: "d36a46235110b57507d221997f2de3bb"
server_key_version: "encryptionkey@0"
I20260811 07:38:31.589819 25010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:31.615927 25010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:31.620517 25010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:31.620730 25010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:31.630198 25010 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.252:40807
I20260811 07:38:31.630764 25109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.252:40807 every 8 connection(s)
I20260811 07:38:31.631767 25010 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
I20260811 07:38:31.635733 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 25010
I20260811 07:38:31.635923 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786433529403386-22547-0/minicluster-data/master-2/wal/instance
I20260811 07:38:31.636241 22547 external_mini_cluster.cc:1428] Setting key 670f9754203f873061988d66713b8f87
I20260811 07:38:31.636757 25110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:31.644194 25110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433911, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:38:31.656708 25116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.638409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59600 (local address 127.22.4.252:40807)
0811 07:38:31.639086 (+ 677us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.639113 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.639179 (+ 66us) server_negotiation.cc:407] Connection header received
0811 07:38:31.640214 (+ 1035us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.640244 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.640838 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.641527 (+ 689us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.642513 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.644170 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.645370 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.646149 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.646369 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.650404 (+ 4035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.650411 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.650424 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.650461 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.652976 (+ 2515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.653576 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.653582 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.653588 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.653734 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.654050 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.654054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.654056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.654642 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.654917 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.655291 (+ 374us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.655636 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":441,"thread_start_us":171,"threads_started":1}
I20260811 07:38:31.658928 24888 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } attempt: 3
I20260811 07:38:31.659483 24891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.647161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51506 (local address 127.22.4.254:34587)
0811 07:38:31.647328 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.647335 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.647955 (+ 620us) server_negotiation.cc:407] Connection header received
0811 07:38:31.648155 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.648161 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.648247 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.648378 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.649423 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.650153 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.651570 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.651828 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.651966 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.654907 (+ 2941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.654912 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.654917 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.654958 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.656870 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.657503 (+ 633us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.657510 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.657515 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.657618 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.658077 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.658081 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.658082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.658417 (+ 335us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.658616 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.659095 (+ 479us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.659280 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260811 07:38:31.659641 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.647131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:34587 (local address 127.0.0.1:51506)
0811 07:38:31.647739 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.647812 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.648001 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.648505 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.648510 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.648981 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.649227 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.649237 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.650357 (+ 1120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.650361 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.651405 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.651420 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.651987 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.651992 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.652171 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.652822 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.652837 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.654673 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.657036 (+ 2363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.657055 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.657063 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.657377 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.657753 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.657758 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.657763 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.657910 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.658577 (+ 667us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.658584 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.658741 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.659008 (+ 267us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.659299 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"spinlock_wait_cycles":5888,"thread_start_us":262,"threads_started":1}
I20260811 07:38:31.661360 25110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433910, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433911, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
I20260811 07:38:31.671607 25116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.660160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59604 (local address 127.22.4.252:40807)
0811 07:38:31.660879 (+ 719us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.660884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.660900 (+ 16us) server_negotiation.cc:407] Connection header received
0811 07:38:31.660947 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.660953 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.661024 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.661176 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.661689 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.662471 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.663645 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.664012 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.664135 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.666689 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.666694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.666767 (+ 73us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.666902 (+ 135us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.668907 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.669557 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.669563 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.669570 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.669661 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.670135 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.670143 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.670146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.670437 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.670634 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.671207 (+ 573us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.671373 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608}
I20260811 07:38:31.671622 24892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.659567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59604)
0811 07:38:31.660182 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.660201 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.660302 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.661202 (+ 900us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.661205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.661436 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.661555 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.661563 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.662705 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.662709 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.663519 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.663528 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.664163 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.664168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.664258 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.664884 (+ 626us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.664896 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.666488 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.669072 (+ 2584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.669076 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.669078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.669412 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.669822 (+ 410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.669827 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.669830 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.669958 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.670685 (+ 727us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.670690 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.670958 (+ 268us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.671115 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.671374 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515}
I20260811 07:38:31.673398 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.662307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49874 (local address 127.22.4.253:45485)
0811 07:38:31.662452 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.662457 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.662472 (+ 15us) server_negotiation.cc:407] Connection header received
0811 07:38:31.662612 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.662617 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.662682 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.662794 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.663328 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.664053 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.665457 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.665924 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.666030 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.669166 (+ 3136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.669172 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.669175 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.669215 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.671187 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.671753 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.671757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.671759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.671858 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.672201 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.672225 (+ 24us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.672226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.672504 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.672635 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.673039 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.673195 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260811 07:38:31.673506 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.662125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:45485 (local address 127.0.0.1:49874)
0811 07:38:31.662388 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.662405 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.662485 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.662817 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.662847 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.663075 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.663197 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.663203 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.664178 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.664181 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.665202 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.665219 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.666368 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.666372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.666529 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.667278 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.667301 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.668894 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.671326 (+ 2432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.671332 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.671337 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.671619 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.671985 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.671988 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.671990 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.672082 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.672616 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.672619 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.672741 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.672974 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.673195 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174}
I20260811 07:38:31.674687 25110 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:38:31.675290 24891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.660569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51514 (local address 127.22.4.254:34587)
0811 07:38:31.660702 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.660708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.660876 (+ 168us) server_negotiation.cc:407] Connection header received
0811 07:38:31.661038 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.661044 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.661099 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.661202 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.662366 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.663208 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.664185 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.664524 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.664653 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.669197 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.669201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.669204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.669231 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.671663 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.672614 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.672617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.672619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.673225 (+ 606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.673728 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.673732 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.673733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.674056 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.674289 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.674958 (+ 669us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.675102 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 07:38:31.676927 24888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69: Bootstrap starting.
I20260811 07:38:31.680440 24888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:31.681517 24888 log.cc:824] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:31.684381 24888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69: No bootstrap required, opened a new log
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433911, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
I20260811 07:38:31.689416 24888 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } }
I20260811 07:38:31.689738 24888 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19e7c30808c7487e93569d75176f7a69, State: Initialized, Role: FOLLOWER
I20260811 07:38:31.690109 24888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } }
I20260811 07:38:31.690701 25121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.691001 25121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:31.691596 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.677592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49880 (local address 127.22.4.253:45485)
0811 07:38:31.677750 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.677755 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.677772 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:38:31.677968 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.677970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.678025 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.678111 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.679159 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.680021 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.681293 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.681601 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.681744 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.685748 (+ 4004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.685755 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.685758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.685800 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.688177 (+ 2377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.689112 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.689117 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.689118 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.689252 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.689772 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.689780 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.689785 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.690189 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.690604 (+ 415us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.691184 (+ 580us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.691385 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:38:31.691936 24888 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:31.693058 25116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.676163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.22.4.252:40807)
0811 07:38:31.682193 (+ 6030us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.682200 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.682222 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:38:31.682279 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.682282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.682342 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.682466 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.683203 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.683754 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.684900 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.685257 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.685365 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.688060 (+ 2695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.688064 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.688067 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.688100 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.690422 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.691058 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.691064 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.691069 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.691162 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.691645 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.691651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.691653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.691956 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.692065 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.692610 (+ 545us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.692807 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5903}
I20260811 07:38:31.693431 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.676082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59618)
0811 07:38:31.676729 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.676763 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.676877 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.682555 (+ 5678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.682562 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.682887 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.683035 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.683043 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.683882 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.683886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.684755 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.684768 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.685526 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.685530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.685628 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.686280 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.686302 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.687870 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.690576 (+ 2706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.690579 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.690581 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.690930 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.691324 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.691328 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.691331 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.691475 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.692108 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.692114 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.692224 (+ 110us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.692474 (+ 250us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.692682 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520}
I20260811 07:38:31.698478 25110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11: Bootstrap starting.
W20260811 07:38:31.700186 25138 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:31.700341 25138 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:31.702299 25110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:31.698236 24785 master_runner.cc:186] Error getting master registration for 127.22.4.253:45485: OK, instance_id { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" instance_seqno: 1786433911303636 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:38:31.703110 24785 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:38:31.703425 25110 log.cc:824] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:31.706154 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:31.706655 25110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11: No bootstrap required, opened a new log
I20260811 07:38:31.708215 24847 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "19e7c30808c7487e93569d75176f7a69"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51514
I20260811 07:38:31.708609 24847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 07:38:31.708783 24847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:31.710657 24847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } }
I20260811 07:38:31.712226 25110 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } }
I20260811 07:38:31.712584 25110 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cad065372614f99838f7a74d6881c11, State: Initialized, Role: FOLLOWER
I20260811 07:38:31.713017 25110 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } }
I20260811 07:38:31.713119 24847 leader_election.cc:288] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [CANDIDATE]: Term 1 election: Requested vote from peers b4c562e038f345f296ec3cc3f9e16baf (127.22.4.253:45485), 0cad065372614f99838f7a74d6881c11 (127.22.4.252:40807)
I20260811 07:38:31.714159 25142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.714533 25142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:31.715886 25110 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:31.715976 25069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "19e7c30808c7487e93569d75176f7a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "0cad065372614f99838f7a74d6881c11"
I20260811 07:38:31.716279 25069 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:31.718751 25069 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e7c30808c7487e93569d75176f7a69 in term 1.
I20260811 07:38:31.719599 24809 leader_election.cc:302] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cad065372614f99838f7a74d6881c11, 19e7c30808c7487e93569d75176f7a69; no voters:
I20260811 07:38:31.720456 25121 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:31.720903 25121 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [term 1 LEADER]: Becoming Leader. State: Replica: 19e7c30808c7487e93569d75176f7a69, State: Running, Role: LEADER
I20260811 07:38:31.721423 25121 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } }
I20260811 07:38:31.724093 25121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19e7c30808c7487e93569d75176f7a69. Latest consensus state: current_term: 1 leader_uuid: "19e7c30808c7487e93569d75176f7a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.724288 25121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:31.726372 24998 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } attempt: 4
I20260811 07:38:31.732543 25170 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:31.733942 25170 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:31.736022 24891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.716650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51518 (local address 127.22.4.254:34587)
0811 07:38:31.716816 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.716821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.720375 (+ 3554us) server_negotiation.cc:407] Connection header received
0811 07:38:31.720920 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.720927 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.721000 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.721063 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.722919 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.723803 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.725725 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.726077 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.726160 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.728421 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.728426 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.728429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.728463 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.731268 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.733279 (+ 2011us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.733286 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.733288 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.733451 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.733940 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.733946 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.733951 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.734314 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.734519 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.735257 (+ 738us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.735789 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 07:38:31.738646 25116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.719343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59630 (local address 127.22.4.252:40807)
0811 07:38:31.719472 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.719477 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.723166 (+ 3689us) server_negotiation.cc:407] Connection header received
0811 07:38:31.723388 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.723391 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.723451 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.723509 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.724958 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.725747 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.727726 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.728058 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.728147 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.733333 (+ 5186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.733339 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.733342 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.733382 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.735704 (+ 2322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.736508 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.736513 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.736515 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.736637 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.737362 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.737366 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.737368 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.737668 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.737808 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.738294 (+ 486us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.738461 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 07:38:31.732828 25010 master_runner.cc:186] Error getting master registration for 127.22.4.253:45485: OK, instance_id { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" instance_seqno: 1786433911303636 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:38:31.741398 25010 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 07:38:31 dist-test-slave-7z32 krb5kdc[24766](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433911, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
W20260811 07:38:31.748546 24815 tablet.cc:2369] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:38:31.749974 25008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.718860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49882 (local address 127.22.4.253:45485)
0811 07:38:31.719122 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.719130 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.721212 (+ 2082us) server_negotiation.cc:407] Connection header received
0811 07:38:31.721578 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.721584 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.721700 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.721771 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.723163 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.723932 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.725268 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.725633 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.725713 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.742381 (+ 16668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.742387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.742390 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.742431 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.744522 (+ 2091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.748136 (+ 3614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.748141 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.748143 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.748263 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.748633 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.748638 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.748640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.748939 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.749104 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.749588 (+ 484us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.749761 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 07:38:31.752303 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.726983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:40807 (local address 127.0.0.1:59640)
0811 07:38:31.727222 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:31.727238 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:31.727334 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:31.739943 (+ 12609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:31.739948 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:31.740225 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:31.740425 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.740434 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.741718 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.741724 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.742635 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:31.742648 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.744225 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.744232 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:31.744366 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.745138 (+ 772us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:31.745155 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:31.747077 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:31.749945 (+ 2868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.749951 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.749954 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.750455 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.750986 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:31.750991 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:31.750993 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:31.751104 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:31.751659 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:31.751663 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:31.751786 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 07:38:31.751894 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:38:31.752088 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260811 07:38:31.753165 25171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:31.727500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59640 (local address 127.22.4.252:40807)
0811 07:38:31.739548 (+ 12048us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.739561 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.739579 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:38:31.739623 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.739626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.739684 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.739857 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.740577 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.741557 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.743210 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:31.744004 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:31.744946 (+ 942us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:31.747348 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:31.747353 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:31.747357 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:31.747393 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:31.749734 (+ 2341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.750598 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.750602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.750604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.750716 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:31.751247 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:31.751250 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:31.751252 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:31.751527 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:31.752692 (+ 1165us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:31.752786 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 07:38:31.752958 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6382,"thread_start_us":200,"threads_started":1}
W20260811 07:38:31.754395 25167 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:31.754536 25167 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:31.755973 25069 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [term 1 FOLLOWER]: Refusing update from remote peer 19e7c30808c7487e93569d75176f7a69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:38:31.756875 25165 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:38:31.758348 24998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: Bootstrap starting.
I20260811 07:38:31.761790 24998 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:31.763209 24998 log.cc:824] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:31.763473 25142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19e7c30808c7487e93569d75176f7a69. Latest consensus state: current_term: 1 leader_uuid: "19e7c30808c7487e93569d75176f7a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.763645 25142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:31.775233 24998 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: No bootstrap required, opened a new log
I20260811 07:38:31.777040 25121 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19e7c30808c7487e93569d75176f7a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.777238 25121 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:31.778318 25142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19e7c30808c7487e93569d75176f7a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.778545 25142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:31.778761 25172 mvcc.cc:205] Tried to move back new op lower bound from 7317233302514352128 to 7317233302416371712. Current Snapshot: MvccSnapshot[applied={T|T < 7317233302514352128}]
I20260811 07:38:31.782411 25176 mvcc.cc:205] Tried to move back new op lower bound from 7317233302514352128 to 7317233302416371712. Current Snapshot: MvccSnapshot[applied={T|T < 7317233302514352128}]
I20260811 07:38:31.784503 24998 raft_consensus.cc:348] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } }
I20260811 07:38:31.785014 24998 raft_consensus.cc:729] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b4c562e038f345f296ec3cc3f9e16baf, State: Initialized, Role: FOLLOWER
I20260811 07:38:31.785719 24998 consensus_queue.cc:260] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } }
I20260811 07:38:31.788906 25170 catalog_manager.cc:1347] Generated new cluster ID: 5413a7c585bc4dc8bfc9aeed500b81c2
I20260811 07:38:31.789062 25170 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:31.789386 24958 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:31.791261 24958 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [term 1 FOLLOWER]: Refusing update from remote peer 19e7c30808c7487e93569d75176f7a69: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:38:31.792295 25165 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:38:31.794211 24959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "19e7c30808c7487e93569d75176f7a69" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b4c562e038f345f296ec3cc3f9e16baf"
I20260811 07:38:31.795447 24998 sys_catalog.cc:564] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:31.797497 24959 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19e7c30808c7487e93569d75176f7a69 in term 1.
W20260811 07:38:31.798473 24926 tablet.cc:2369] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:38:31.805234 25182 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19e7c30808c7487e93569d75176f7a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.806021 25182 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:31.806221 25182 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "19e7c30808c7487e93569d75176f7a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.806385 25182 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:31.806763 25196 sys_catalog.cc:455] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19e7c30808c7487e93569d75176f7a69. Latest consensus state: current_term: 1 leader_uuid: "19e7c30808c7487e93569d75176f7a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.807294 25196 sys_catalog.cc:458] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:31.816381 25197 mvcc.cc:205] Tried to move back new op lower bound from 7317233302514352128 to 7317233302416371712. Current Snapshot: MvccSnapshot[applied={T|T < 7317233302514352128}]
I20260811 07:38:31.820335 25165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "19e7c30808c7487e93569d75176f7a69" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "19e7c30808c7487e93569d75176f7a69" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 34587 } } peers { permanent_uuid: "b4c562e038f345f296ec3cc3f9e16baf" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 45485 } } peers { permanent_uuid: "0cad065372614f99838f7a74d6881c11" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 40807 } } }
I20260811 07:38:31.820564 25165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69 [sys.catalog]: This master's current role is: LEADER
W20260811 07:38:31.823228 25204 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:31.823359 25204 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:31.825438 25170 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:31.827152 25170 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:31.847059 25170 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19e7c30808c7487e93569d75176f7a69: Generated new TSK 0
I20260811 07:38:31.848527 25170 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:38:31.901975 24891 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.897850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51522 (local address 127.22.4.254:34587)
0811 07:38:31.898027 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.898033 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.900487 (+ 2454us) server_negotiation.cc:407] Connection header received
0811 07:38:31.900778 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.900783 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.900852 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.900917 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.901782 (+ 865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51522: BlockingRecv error: recv got EOF from 127.0.0.1:51522 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260811 07:38:31.904528 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.898872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49884 (local address 127.22.4.253:45485)
0811 07:38:31.899025 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.899030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.902552 (+ 3522us) server_negotiation.cc:407] Connection header received
0811 07:38:31.903424 (+ 872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.903428 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.903504 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.903566 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.904328 (+ 762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49884: BlockingRecv error: recv got EOF from 127.0.0.1:49884 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 07:38:31.905977 25171 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.899470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.22.4.252:40807)
0811 07:38:31.899718 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.899725 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.903090 (+ 3365us) server_negotiation.cc:407] Connection header received
0811 07:38:31.905020 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.905024 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.905100 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.905162 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.905838 (+ 676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59652: BlockingRecv error: recv got EOF from 127.0.0.1:59652 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260811 07:38:31.913487 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.911155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49892 (local address 127.22.4.253:45485)
0811 07:38:31.911315 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.911321 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.911959 (+ 638us) server_negotiation.cc:407] Connection header received
0811 07:38:31.912312 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.912317 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.912435 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.912498 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.913309 (+ 811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49892: BlockingRecv error: recv got EOF from 127.0.0.1:49892 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 07:38:31.922061 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.919229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49904 (local address 127.22.4.253:45485)
0811 07:38:31.919420 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.919428 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.920501 (+ 1073us) server_negotiation.cc:407] Connection header received
0811 07:38:31.920808 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.920813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.920904 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.920987 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.921873 (+ 886us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49904: BlockingRecv error: recv got EOF from 127.0.0.1:49904 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260811 07:38:31.930070 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.927698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49920 (local address 127.22.4.253:45485)
0811 07:38:31.927872 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.927877 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.928709 (+ 832us) server_negotiation.cc:407] Connection header received
0811 07:38:31.928983 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.928988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.929061 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.929139 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.929894 (+ 755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49920: BlockingRecv error: recv got EOF from 127.0.0.1:49920 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260811 07:38:31.939965 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.937494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49930 (local address 127.22.4.253:45485)
0811 07:38:31.937679 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.937685 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.938558 (+ 873us) server_negotiation.cc:407] Connection header received
0811 07:38:31.938870 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.938874 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.938952 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.939021 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.939792 (+ 771us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49930: BlockingRecv error: recv got EOF from 127.0.0.1:49930 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 07:38:31.954401 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.951583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49940 (local address 127.22.4.253:45485)
0811 07:38:31.951860 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.951867 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.952882 (+ 1015us) server_negotiation.cc:407] Connection header received
0811 07:38:31.953216 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.953221 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.953299 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.953373 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.954224 (+ 851us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49940: BlockingRecv error: recv got EOF from 127.0.0.1:49940 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260811 07:38:31.977618 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:31.975226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49950 (local address 127.22.4.253:45485)
0811 07:38:31.975405 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:31.975410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:31.976249 (+ 839us) server_negotiation.cc:407] Connection header received
0811 07:38:31.976522 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:31.976527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:31.976617 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:31.976680 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:31.977427 (+ 747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49950: BlockingRecv error: recv got EOF from 127.0.0.1:49950 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 07:38:32.015750 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:32.013769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49952 (local address 127.22.4.253:45485)
0811 07:38:32.013952 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:32.013958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:32.014404 (+ 446us) server_negotiation.cc:407] Connection header received
0811 07:38:32.014591 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:32.014596 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:32.014685 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:32.014816 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:32.015591 (+ 775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49952: BlockingRecv error: recv got EOF from 127.0.0.1:49952 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260811 07:38:32.084180 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:32.082675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49962 (local address 127.22.4.253:45485)
0811 07:38:32.082959 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:32.082963 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:32.082996 (+ 33us) server_negotiation.cc:407] Connection header received
0811 07:38:32.083218 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:32.083221 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:32.083287 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:32.083406 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:32.084062 (+ 656us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49962: BlockingRecv error: recv got EOF from 127.0.0.1:49962 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
W20260811 07:38:32.217620 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:32.215667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49968 (local address 127.22.4.253:45485)
0811 07:38:32.215904 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:32.215911 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:32.216142 (+ 231us) server_negotiation.cc:407] Connection header received
0811 07:38:32.216440 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:32.216448 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:32.216538 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:32.216654 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:32.217345 (+ 691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49968: BlockingRecv error: recv got EOF from 127.0.0.1:49968 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260811 07:38:32.478375 25008 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:32.476884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49984 (local address 127.22.4.253:45485)
0811 07:38:32.477084 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:32.477090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:32.477237 (+ 147us) server_negotiation.cc:407] Connection header received
0811 07:38:32.477474 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:32.477477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:32.477532 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:32.477634 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:32.478223 (+ 589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49984: BlockingRecv error: recv got EOF from 127.0.0.1:49984 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
I20260811 07:38:32.756328 25167 catalog_manager.cc:1259] Loaded cluster ID: 5413a7c585bc4dc8bfc9aeed500b81c2
I20260811 07:38:32.756438 25167 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11: loading cluster ID for follower catalog manager: success
I20260811 07:38:32.758594 25167 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11: acquiring CA information for follower catalog manager: success
I20260811 07:38:32.760125 25167 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 0cad065372614f99838f7a74d6881c11: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:38:32.825078 25204 catalog_manager.cc:1259] Loaded cluster ID: 5413a7c585bc4dc8bfc9aeed500b81c2
I20260811 07:38:32.825265 25204 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: loading cluster ID for follower catalog manager: success
I20260811 07:38:32.827659 25204 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: acquiring CA information for follower catalog manager: success
I20260811 07:38:32.829345 25204 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b4c562e038f345f296ec3cc3f9e16baf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:38:32.999250 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:32.994236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49994 (local address 127.22.4.253:45485)
0811 07:38:32.994558 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:32.994563 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:32.994621 (+ 58us) server_negotiation.cc:407] Connection header received
0811 07:38:32.994809 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:32.994812 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:32.995031 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:32.995197 (+ 166us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:32.995518 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:32.996122 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:32.997139 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:32.997526 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:32.997638 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:32.998014 (+ 376us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:32.998667 (+ 653us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:32.998796 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:32.998934 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 07:38:32.999010 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":85,"threads_started":1}
I20260811 07:38:33.009469 25324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:33.003757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59666 (local address 127.22.4.252:40807)
0811 07:38:33.004156 (+ 399us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:33.004161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:33.004180 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:38:33.004283 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:33.004285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:33.004477 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:33.004605 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:33.004947 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:33.005788 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:33.006972 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:33.007254 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:33.007383 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:33.007796 (+ 413us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:33.008710 (+ 914us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:33.008913 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:33.009143 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 07:38:33.009254 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":115,"threads_started":1}
I20260811 07:38:33.019008 25324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:33.013998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59682 (local address 127.22.4.252:40807)
0811 07:38:33.014162 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:33.014167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:33.014672 (+ 505us) server_negotiation.cc:407] Connection header received
0811 07:38:33.014952 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:33.014956 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:33.015045 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:33.015139 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:33.015582 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:33.016417 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:33.017626 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:33.017913 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:33.018036 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:33.018363 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:33.018452 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:33.018559 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:33.018713 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 07:38:33.018780 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 07:38:33.020479 25313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:33.014608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50006 (local address 127.22.4.253:45485)
0811 07:38:33.014777 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:33.014783 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:33.015366 (+ 583us) server_negotiation.cc:407] Connection header received
0811 07:38:33.015555 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:33.015561 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:33.015654 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:33.015740 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:33.016045 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:33.016813 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:33.018691 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:33.019155 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:33.019242 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:33.019879 (+ 637us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:33.019981 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:33.020070 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:33.020244 (+ 174us) server_negotiation.cc:299] Negotiation successful
0811 07:38:33.020329 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260811 07:38:33.021073 25335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:33.014184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51528 (local address 127.22.4.254:34587)
0811 07:38:33.014615 (+ 431us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:33.014622 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:33.014645 (+ 23us) server_negotiation.cc:407] Connection header received
0811 07:38:33.014894 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:33.014899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:33.015272 (+ 373us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:33.015501 (+ 229us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:33.015983 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:33.016795 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:33.018649 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:33.019078 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:33.019207 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:33.019805 (+ 598us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:33.020291 (+ 486us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:33.020387 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:33.020756 (+ 369us) server_negotiation.cc:299] Negotiation successful
0811 07:38:33.020842 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":101,"threads_started":1}
I20260811 07:38:33.026499 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24785
I20260811 07:38:33.047683 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 24896
I20260811 07:38:33.065593 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 25010
2026-08-11T07:38:33Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3825 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 07:38:33 dist-test-slave-7z32 krb5kdc[25347](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 07:38:33 dist-test-slave-7z32 krb5kdc[25347](info): set up 2 sockets
Aug 11 07:38:33 dist-test-slave-7z32 krb5kdc[25347](info): commencing operation
krb5kdc: starting...
W20260811 07:38:34.469790 22547 mini_kdc.cc:121] Time spent starting KDC: real 1.365s user 0.000s sys 0.012s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/test-user.keytab.
Aug 11 07:38:34 dist-test-slave-7z32 krb5kdc[25347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T07:38:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T07:38:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.22.4.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
Entry for principal kudu/127.22.4.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab.
I20260811 07:38:34.660053 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:46153
--webserver_interface=127.22.4.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:46153,127.22.4.253:43375,127.22.4.252:36383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 07:38:34.828887 25365 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:38:34.829443 25365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:34.829507 25365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:34.829607 25365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:34.835148 25365 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:34.835353 25365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:34.835393 25365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:34.835424 25365 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:34.835466 25365 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:34.842507 25365 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:46153,127.22.4.253:43375,127.22.4.252:36383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.254.keytab
--principal=kudu/127.22.4.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.254:46153
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.22.4.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:34.844321 25365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:34.845824 25365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:34.859668 25372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:34.859795 25371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:34.859668 25377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:34.860288 25365 server_base.cc:1034] running on GCE node
I20260811 07:38:34.861253 25365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:34.863189 25365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:34.864635 25365 hybrid_clock.cc:648] HybridClock initialized: now 1786433914864572 us; error 75 us; skew 500 ppm
Aug 11 07:38:34 dist-test-slave-7z32 krb5kdc[25347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433914, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:34.869493 25365 init.cc:377] Logged in from keytab as kudu/127.22.4.254@KRBTEST.COM (short username kudu)
I20260811 07:38:34.872287 25365 webserver.cc:460] Webserver started at http://127.22.4.254:40027/ using document root <none> and password file <none>
I20260811 07:38:34.873497 25365 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:34.873615 25365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:34.873957 25365 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:34.877740 25365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/data/instance:
uuid: "18fd8e3d0df347e691cb7bebf455ff0e"
format_stamp: "Formatted at 2026-08-11 07:38:34 on dist-test-slave-7z32"
server_key: "12b29bfe0c3658bd9186b4876c74da5e"
server_key_iv: "99089144248f114c2509bcb88d43fe4c"
server_key_version: "encryptionkey@0"
I20260811 07:38:34.878818 25365 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/wal/instance:
uuid: "18fd8e3d0df347e691cb7bebf455ff0e"
format_stamp: "Formatted at 2026-08-11 07:38:34 on dist-test-slave-7z32"
server_key: "12b29bfe0c3658bd9186b4876c74da5e"
server_key_iv: "99089144248f114c2509bcb88d43fe4c"
server_key_version: "encryptionkey@0"
I20260811 07:38:34.889804 25365 fs_manager.cc:691] Time spent creating directory manager: real 0.010s user 0.005s sys 0.003s
I20260811 07:38:34.895831 25388 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:34.900023 25365 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.006s sys 0.000s
I20260811 07:38:34.900322 25365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/wal
uuid: "18fd8e3d0df347e691cb7bebf455ff0e"
format_stamp: "Formatted at 2026-08-11 07:38:34 on dist-test-slave-7z32"
server_key: "12b29bfe0c3658bd9186b4876c74da5e"
server_key_iv: "99089144248f114c2509bcb88d43fe4c"
server_key_version: "encryptionkey@0"
I20260811 07:38:34.900591 25365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:34.927300 25365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:34.933686 25365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:34.934170 25365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:34.946134 25365 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.254:46153
I20260811 07:38:34.946714 25477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.254:46153 every 8 connection(s)
I20260811 07:38:34.947718 25365 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/data/info.pb
I20260811 07:38:34.951809 25478 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:34.955482 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 25365
I20260811 07:38:34.955806 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-0/wal/instance
I20260811 07:38:34.956483 22547 external_mini_cluster.cc:1428] Setting key 3898b1d4261c7297bbac9ead465ef074
I20260811 07:38:34.957911 25478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.4.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.253@KRBTEST.COM" created.
Aug 11 07:38:34 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433914, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:38:34.999394 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:34.961279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46153 (local address 127.0.0.1:34920)
0811 07:38:34.962605 (+ 1326us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:34.962679 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:34.964419 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:34.965939 (+ 1520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:34.965952 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:34.966923 (+ 971us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:34.967612 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:34.967651 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:34.973917 (+ 6266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:34.973924 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:34.977082 (+ 3158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:34.977115 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:34.978308 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:34.978313 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:34.978439 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:34.979592 (+ 1153us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:34.979633 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:34.987404 (+ 7771us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:34.990869 (+ 3465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:34.990897 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:34.990925 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:34.991592 (+ 667us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:34.994238 (+ 2646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:34.994244 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:34.994246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:34.994524 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:34.996208 (+ 1684us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:34.996219 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:34.996423 (+ 204us) client_negotiation.cc:769] Sending connection context
0811 07:38:34.996634 (+ 211us) client_negotiation.cc:240] Negotiation successful
0811 07:38:34.997251 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":975,"thread_start_us":247,"threads_started":1}
I20260811 07:38:35.000907 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:34.961281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34920 (local address 127.22.4.254:46153)
0811 07:38:34.962527 (+ 1246us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:34.962563 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:34.963050 (+ 487us) server_negotiation.cc:407] Connection header received
0811 07:38:34.965037 (+ 1987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:34.965051 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:34.965505 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:34.965812 (+ 307us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:34.969605 (+ 3793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:34.973636 (+ 4031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:34.977336 (+ 3700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:34.978066 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:34.978313 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:34.987655 (+ 9342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:34.987669 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:34.987691 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:34.987729 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:34.990530 (+ 2801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:34.993646 (+ 3116us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:34.993660 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:34.993665 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:34.993975 (+ 310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:34.994728 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:34.994733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:34.994735 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:34.995933 (+ 1198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:34.996157 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:34.999146 (+ 2989us) server_negotiation.cc:299] Negotiation successful
0811 07:38:34.999451 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1041,"spinlock_wait_cycles":1280,"thread_start_us":255,"threads_started":1}
I20260811 07:38:35.006172 25478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:38:35.007752 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.007010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48432)
0811 07:38:35.007383 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.007556 (+ 173us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166}
W20260811 07:38:35.011219 25394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
I20260811 07:38:35.013648 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.013088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48444)
0811 07:38:35.013384 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.013484 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
W20260811 07:38:35.014390 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:43375: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab.
Entry for principal kudu/127.22.4.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab.
I20260811 07:38:35.032892 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.253:43375
--webserver_interface=127.22.4.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab
--principal=kudu/127.22.4.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:46153,127.22.4.253:43375,127.22.4.252:36383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:38:35.063783 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } attempt: 1
I20260811 07:38:35.065001 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.064509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48450)
0811 07:38:35.064799 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.064901 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164}
I20260811 07:38:35.066800 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.066236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48462)
0811 07:38:35.066466 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.066618 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 07:38:35.067104 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:43375: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
I20260811 07:38:35.135399 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } attempt: 2
I20260811 07:38:35.137022 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.136366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48470)
0811 07:38:35.136605 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.136707 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 07:38:35.138604 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.138120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48474)
0811 07:38:35.138374 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.138500 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260811 07:38:35.138962 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:43375: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
W20260811 07:38:35.215857 25489 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:38:35.216375 25489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:35.216451 25489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:35.216543 25489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:35.221535 25489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:35.221662 25489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:35.221700 25489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:35.221741 25489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:35.221803 25489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:35.228000 25489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:46153,127.22.4.253:43375,127.22.4.252:36383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.253.keytab
--principal=kudu/127.22.4.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.253:43375
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.22.4.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:35.229398 25489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:35.230222 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } attempt: 3
I20260811 07:38:35.230742 25489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 07:38:35.231659 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.231194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48490)
0811 07:38:35.231436 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.231548 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 07:38:35.232666 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.232393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48494)
0811 07:38:35.232523 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.232593 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 07:38:35.232846 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.253:43375: Network error: Client connection negotiation failed: client connection to 127.22.4.253:43375: connect: Connection refused (error 111)
W20260811 07:38:35.241808 25497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:35.241863 25501 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:35.241829 25498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:35.242501 25489 server_base.cc:1034] running on GCE node
I20260811 07:38:35.243459 25489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:35.245296 25489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:35.246558 25489 hybrid_clock.cc:648] HybridClock initialized: now 1786433915246466 us; error 124 us; skew 500 ppm
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433915, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:35.251247 25489 init.cc:377] Logged in from keytab as kudu/127.22.4.253@KRBTEST.COM (short username kudu)
I20260811 07:38:35.252543 25489 webserver.cc:460] Webserver started at http://127.22.4.253:39803/ using document root <none> and password file <none>
I20260811 07:38:35.253222 25489 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:35.253300 25489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:35.253667 25489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:35.256714 25489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/data/instance:
uuid: "04495972e7294821b8c55cc23b858578"
format_stamp: "Formatted at 2026-08-11 07:38:35 on dist-test-slave-7z32"
server_key: "702c7e1a274a03700a04597116c3942d"
server_key_iv: "74524f6eece402831286e65e0d433cc6"
server_key_version: "encryptionkey@0"
I20260811 07:38:35.257506 25489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/wal/instance:
uuid: "04495972e7294821b8c55cc23b858578"
format_stamp: "Formatted at 2026-08-11 07:38:35 on dist-test-slave-7z32"
server_key: "702c7e1a274a03700a04597116c3942d"
server_key_iv: "74524f6eece402831286e65e0d433cc6"
server_key_version: "encryptionkey@0"
I20260811 07:38:35.262449 25489 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260811 07:38:35.266204 25509 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:35.268486 25489 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:38:35.268685 25489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/wal
uuid: "04495972e7294821b8c55cc23b858578"
format_stamp: "Formatted at 2026-08-11 07:38:35 on dist-test-slave-7z32"
server_key: "702c7e1a274a03700a04597116c3942d"
server_key_iv: "74524f6eece402831286e65e0d433cc6"
server_key_version: "encryptionkey@0"
I20260811 07:38:35.268819 25489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:35.326179 25489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:35.331382 25489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:35.331653 25489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:35.344385 25489 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.253:43375
I20260811 07:38:35.344902 25593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.253:43375 every 8 connection(s)
I20260811 07:38:35.346335 25489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/data/info.pb
I20260811 07:38:35.350970 25595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:35.351715 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 25489
I20260811 07:38:35.351876 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-1/wal/instance
I20260811 07:38:35.352315 22547 external_mini_cluster.cc:1428] Setting key 5a0654300d60295a202e735b3ce9be07
I20260811 07:38:35.357637 25595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.22.4.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.22.4.252@KRBTEST.COM" created.
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433915, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:38:35.376041 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } attempt: 4
I20260811 07:38:35.380200 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.360754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34924 (local address 127.22.4.254:46153)
0811 07:38:35.360973 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.360978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.363107 (+ 2129us) server_negotiation.cc:407] Connection header received
0811 07:38:35.364341 (+ 1234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.364346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.364420 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.364522 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.365990 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.366580 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.368148 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.368425 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.368556 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.372927 (+ 4371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.372932 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.372934 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.373239 (+ 305us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.376943 (+ 3704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.377968 (+ 1025us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.377972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.377974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.378091 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.378647 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.378650 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.378651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.378984 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.379113 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.379810 (+ 697us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.379990 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":88}
I20260811 07:38:35.381307 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.361796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46153 (local address 127.0.0.1:34924)
0811 07:38:35.362797 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.362925 (+ 128us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:35.364079 (+ 1154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:35.364737 (+ 658us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:35.364744 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:35.365218 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:35.365813 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.365829 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.366747 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.366750 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.367989 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.368002 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.368633 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.368638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.368830 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.369574 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:35.369593 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:35.372633 (+ 3040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:35.377213 (+ 4580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.377232 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.377253 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.377773 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.378238 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.378245 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.378251 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.378502 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.379123 (+ 621us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:35.379135 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:35.379492 (+ 357us) client_negotiation.cc:769] Sending connection context
0811 07:38:35.379725 (+ 233us) client_negotiation.cc:240] Negotiation successful
0811 07:38:35.380164 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":4,"thread_start_us":307,"threads_started":1}
I20260811 07:38:35.383502 25595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433914, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433915, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
I20260811 07:38:35.392310 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.376941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48500)
0811 07:38:35.377392 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.377415 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:35.377540 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:35.378422 (+ 882us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:35.378429 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:35.378728 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:35.379016 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.379029 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.381356 (+ 2327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.381361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.382249 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.382261 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.383490 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.383498 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.383912 (+ 414us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.384719 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:35.384735 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:35.386800 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:35.389705 (+ 2905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.389712 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.389718 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.390109 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.390700 (+ 591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.390706 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.390709 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.390865 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.391585 (+ 720us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:35.391592 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:35.391758 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 07:38:35.391853 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 07:38:35.392033 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315}
I20260811 07:38:35.393229 25604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.377092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48500 (local address 127.22.4.253:43375)
0811 07:38:35.377731 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.377748 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.377784 (+ 36us) server_negotiation.cc:407] Connection header received
0811 07:38:35.377842 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.377850 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.378171 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.378383 (+ 212us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.379239 (+ 856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.381160 (+ 1921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.382669 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.383310 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.383445 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.387049 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.387064 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.387085 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.387122 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.389540 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.390291 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.390302 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.390307 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.390469 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.390999 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.391002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.391003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.391444 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.391587 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.392652 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.392960 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":282,"threads_started":1}
I20260811 07:38:35.396320 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.384202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48508)
0811 07:38:35.384398 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.384416 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:35.384516 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:35.384983 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:35.384986 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:35.385196 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:35.385289 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.385295 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.386645 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.386654 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.387953 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.387975 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.388812 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.388815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.388978 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.389571 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:35.389591 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:35.391540 (+ 1949us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:35.394230 (+ 2690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.394233 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.394235 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.394453 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.394853 (+ 400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.394859 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.394864 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.394961 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.395687 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:35.395690 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:35.395791 (+ 101us) client_negotiation.cc:769] Sending connection context
0811 07:38:35.395899 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 07:38:35.396090 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":28}
I20260811 07:38:35.396338 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.384362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48508 (local address 127.22.4.253:43375)
0811 07:38:35.384766 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.384773 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.384783 (+ 10us) server_negotiation.cc:407] Connection header received
0811 07:38:35.384812 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.384814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.384850 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.384970 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.385413 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.386420 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.388155 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.388638 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.388784 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.391744 (+ 2960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.391748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.391750 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.391771 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.394096 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.394571 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.394576 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.394577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.394662 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.395260 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.395267 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.395269 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.395577 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.395701 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.395975 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.396163 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":74,"server-negotiator.queue_time_us":347,"thread_start_us":170,"threads_started":1}
I20260811 07:38:35.396430 25478 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:38:35.397452 25595 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } has no permanent_uuid. Determining permanent_uuid...
I20260811 07:38:35.397894 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.397280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43738)
0811 07:38:35.397672 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.397759 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246}
I20260811 07:38:35.398636 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.398104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43746)
0811 07:38:35.398328 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.398453 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260811 07:38:35.399150 25513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
I20260811 07:38:35.399209 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.398804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43748)
0811 07:38:35.399071 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.399138 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188}
W20260811 07:38:35.399396 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:36383: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
I20260811 07:38:35.400533 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.400135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43754)
0811 07:38:35.400312 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.400387 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260811 07:38:35.400888 25595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:36383: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.22.4.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab.
Entry for principal kudu/127.22.4.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab.
I20260811 07:38:35.403685 22547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
/tmp/dist-test-taskV24Qp8/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.252:36383
--webserver_interface=127.22.4.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab
--principal=kudu/127.22.4.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.22.4.212:40079
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.22.4.254:46153,127.22.4.253:43375,127.22.4.252:36383
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 07:38:35.450260 25595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } attempt: 1
I20260811 07:38:35.451670 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.451107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43758)
0811 07:38:35.451399 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.451522 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260811 07:38:35.452805 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.452515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43764)
0811 07:38:35.452645 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.452716 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260811 07:38:35.453047 25595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:36383: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
I20260811 07:38:35.458606 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } attempt: 1
I20260811 07:38:35.459851 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.459401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43774)
0811 07:38:35.459626 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.459724 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 07:38:35.460852 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.460596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43778)
0811 07:38:35.460722 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.460784 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260811 07:38:35.461089 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:36383: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
I20260811 07:38:35.521397 25595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } attempt: 2
I20260811 07:38:35.522734 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.522100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43786)
0811 07:38:35.522419 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.522561 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260811 07:38:35.523936 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.523643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43790)
0811 07:38:35.523797 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.523869 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260811 07:38:35.524205 25595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:36383: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
I20260811 07:38:35.528330 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } attempt: 2
I20260811 07:38:35.529491 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.529047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43792)
0811 07:38:35.529261 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.529388 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260811 07:38:35.530319 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.530096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43804)
0811 07:38:35.530203 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.530265 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 07:38:35.530469 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:36383: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
W20260811 07:38:35.577194 25608 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 07:38:35.577812 25608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 07:38:35.577906 25608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 07:38:35.578043 25608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 07:38:35.583791 25608 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 07:38:35.583989 25608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 07:38:35.584033 25608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 07:38:35.584069 25608 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 07:38:35.584120 25608 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 07:38:35.591214 25608 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.22.4.212:40079
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.22.4.254:46153,127.22.4.253:43375,127.22.4.252:36383
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/krb5kdc/kudu_127.22.4.252.keytab
--principal=kudu/127.22.4.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.22.4.252:36383
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.22.4.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 11 Aug 2026 06:46:31 UTC on ccycloud.quasar-atskvk.root.comops.site
build id 4579820
I20260811 07:38:35.593003 25608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 07:38:35.594563 25608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 07:38:35.606556 25622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 07:38:35.606534 25618 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:35.606796 25608 server_base.cc:1034] running on GCE node
W20260811 07:38:35.607080 25619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 07:38:35.608078 25608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 07:38:35.610028 25608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 07:38:35.611428 25608 hybrid_clock.cc:648] HybridClock initialized: now 1786433915611371 us; error 75 us; skew 500 ppm
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433915, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 07:38:35.615531 25595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } attempt: 3
I20260811 07:38:35.615823 25608 init.cc:377] Logged in from keytab as kudu/127.22.4.252@KRBTEST.COM (short username kudu)
I20260811 07:38:35.616644 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.616201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43816)
0811 07:38:35.616469 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.616536 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
I20260811 07:38:35.617439 25608 webserver.cc:460] Webserver started at http://127.22.4.252:34245/ using document root <none> and password file <none>
I20260811 07:38:35.617497 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.617208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43818)
0811 07:38:35.617370 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.617430 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260811 07:38:35.617709 25595 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:36383: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
I20260811 07:38:35.618412 25608 fs_manager.cc:359] Metadata directory not provided
I20260811 07:38:35.618502 25608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 07:38:35.618809 25608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 07:38:35.621999 25608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/data/instance:
uuid: "ece8fb90f17642f2a725ac79a3be5da2"
format_stamp: "Formatted at 2026-08-11 07:38:35 on dist-test-slave-7z32"
server_key: "191f5023f090a2120145f9bf5525941f"
server_key_iv: "906149e25cdece23cb0cfc709d3b4eb1"
server_key_version: "encryptionkey@0"
I20260811 07:38:35.622938 25608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/wal/instance:
uuid: "ece8fb90f17642f2a725ac79a3be5da2"
format_stamp: "Formatted at 2026-08-11 07:38:35 on dist-test-slave-7z32"
server_key: "191f5023f090a2120145f9bf5525941f"
server_key_iv: "906149e25cdece23cb0cfc709d3b4eb1"
server_key_version: "encryptionkey@0"
I20260811 07:38:35.628918 25608 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.000s sys 0.004s
I20260811 07:38:35.630668 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } attempt: 3
I20260811 07:38:35.631718 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.631381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43828)
0811 07:38:35.631534 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.631608 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260811 07:38:35.632681 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.632439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43838)
0811 07:38:35.632550 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.632619 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260811 07:38:35.632826 25478 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.22.4.252:36383: Network error: Client connection negotiation failed: client connection to 127.22.4.252:36383: connect: Connection refused (error 111)
I20260811 07:38:35.633419 25629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 07:38:35.635780 25608 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260811 07:38:35.636044 25608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/data,/tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/wal
uuid: "ece8fb90f17642f2a725ac79a3be5da2"
format_stamp: "Formatted at 2026-08-11 07:38:35 on dist-test-slave-7z32"
server_key: "191f5023f090a2120145f9bf5525941f"
server_key_iv: "906149e25cdece23cb0cfc709d3b4eb1"
server_key_version: "encryptionkey@0"
I20260811 07:38:35.636225 25608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 07:38:35.663906 25608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 07:38:35.668843 25608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 07:38:35.669142 25608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 07:38:35.680734 25608 rpc_server.cc:307] RPC server started. Bound to: 127.22.4.252:36383
I20260811 07:38:35.681139 25710 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.22.4.252:36383 every 8 connection(s)
I20260811 07:38:35.682776 25608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/data/info.pb
I20260811 07:38:35.688341 22547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu as pid 25608
I20260811 07:38:35.688508 22547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskV24Qp8/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786433529403386-22547-0/minicluster-data/master-2/wal/instance
I20260811 07:38:35.688747 25711 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 07:38:35.688925 22547 external_mini_cluster.cc:1428] Setting key 33357a09daba88382b6fd3957f0fbe35
I20260811 07:38:35.696336 25711 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433915, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
I20260811 07:38:35.711817 25714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.691381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43844 (local address 127.22.4.252:36383)
0811 07:38:35.692117 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.692151 (+ 34us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.692209 (+ 58us) server_negotiation.cc:407] Connection header received
0811 07:38:35.693577 (+ 1368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.693614 (+ 37us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.694211 (+ 597us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.694815 (+ 604us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.696180 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.697701 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.699493 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.700264 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.700518 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.704302 (+ 3784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.704311 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.704326 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.704383 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.707018 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.707842 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.707849 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.707856 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.708092 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.708547 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.708551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.708555 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.709329 (+ 774us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.709651 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.710094 (+ 443us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.710492 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":255,"threads_started":1}
I20260811 07:38:35.714869 25715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.699900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.254:46153 (local address 127.0.0.1:34934)
0811 07:38:35.700647 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.700726 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:35.700933 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:35.701574 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:35.701581 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:35.702150 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:35.702350 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.702363 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.703672 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.703683 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.704628 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.704642 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.705309 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.705312 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.705430 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.706138 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:35.706152 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:35.708237 (+ 2085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:35.710778 (+ 2541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.710791 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.710799 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.711335 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.711719 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.711722 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.711723 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.711838 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.713993 (+ 2155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:35.714004 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:35.714159 (+ 155us) client_negotiation.cc:769] Sending connection context
0811 07:38:35.714341 (+ 182us) client_negotiation.cc:240] Negotiation successful
0811 07:38:35.714602 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":322,"threads_started":1}
I20260811 07:38:35.714818 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.699884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34934 (local address 127.22.4.254:46153)
0811 07:38:35.700198 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.700206 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.700867 (+ 661us) server_negotiation.cc:407] Connection header received
0811 07:38:35.701150 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.701153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.701262 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.701471 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.702551 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.703396 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.704796 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.705138 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.705288 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.708465 (+ 3177us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.708472 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.708478 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.708517 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.710589 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.711469 (+ 880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.711473 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.711475 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.711584 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.713481 (+ 1897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.713486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.713488 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.713815 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.713981 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.714411 (+ 430us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.714593 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260811 07:38:35.716426 25711 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.254@KRBTEST.COM
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433915, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
I20260811 07:38:35.728037 25715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.717191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.253:43375 (local address 127.0.0.1:48512)
0811 07:38:35.717427 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.717444 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:35.717536 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:35.717852 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:35.717855 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:35.718080 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:35.718222 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.718229 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.719187 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.719191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.719950 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.719969 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.720503 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.720506 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.720625 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.721157 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:35.721169 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:35.723211 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:35.725692 (+ 2481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.725696 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.725698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.725996 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.726411 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.726414 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.726416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.726635 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.727342 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:35.727351 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:35.727498 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 07:38:35.727629 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 07:38:35.727836 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260811 07:38:35.728042 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.717322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48512 (local address 127.22.4.253:43375)
0811 07:38:35.717522 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.717527 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.717544 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:38:35.717633 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.717636 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.717695 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.717836 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.718378 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.719060 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.720089 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.720367 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.720493 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.723444 (+ 2951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.723451 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.723455 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.723497 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.725512 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.726184 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.726188 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.726189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.726274 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.726772 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.726778 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.726780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.727090 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.727217 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.727707 (+ 490us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.727849 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260811 07:38:35.728087 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.715701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34936 (local address 127.22.4.254:46153)
0811 07:38:35.715938 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.715943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.715960 (+ 17us) server_negotiation.cc:407] Connection header received
0811 07:38:35.716086 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.716089 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.716148 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.716242 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.717158 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.717919 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.718853 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.719108 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.719236 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.722609 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.722614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.722617 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.722657 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.725142 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.725887 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.725891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.725892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.725992 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.726351 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.726357 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.726361 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.726633 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.727116 (+ 483us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.727467 (+ 351us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.727654 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260811 07:38:35.729701 25711 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433915, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.252@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.22.4.253@KRBTEST.COM
I20260811 07:38:35.742650 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.729916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48514 (local address 127.22.4.253:43375)
0811 07:38:35.730071 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.730076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.730170 (+ 94us) server_negotiation.cc:407] Connection header received
0811 07:38:35.730283 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.730289 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.730353 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.730442 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.731480 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.732325 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.733632 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.733988 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.734117 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.738178 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.738182 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.738184 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.738220 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.740163 (+ 1943us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.740832 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.740836 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.740838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.740930 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.741381 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.741384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.741385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.741682 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.742017 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.742292 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.742456 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 07:38:35.742650 25715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.730429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43858)
0811 07:38:35.730763 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.730778 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:35.730927 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:35.731235 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:35.731239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:35.731453 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:35.731573 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.731579 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.732638 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.732641 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.733497 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.733508 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.734162 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.734166 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.734261 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.735137 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:35.735156 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:35.737216 (+ 2060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:35.740081 (+ 2865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.740086 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.740088 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.740537 (+ 449us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.741031 (+ 494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.741036 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.741040 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.741192 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.741816 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:35.741822 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:35.741921 (+ 99us) client_negotiation.cc:769] Sending connection context
0811 07:38:35.742100 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 07:38:35.742471 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237}
I20260811 07:38:35.743600 25714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.730594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43858 (local address 127.22.4.252:36383)
0811 07:38:35.730788 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.730792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.730874 (+ 82us) server_negotiation.cc:407] Connection header received
0811 07:38:35.731061 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.731063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.731106 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.731170 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.731741 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.732506 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.733632 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.734027 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.734125 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.737416 (+ 3291us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.737422 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.737424 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.737456 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.739864 (+ 2408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.740709 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.740712 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.740714 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.740845 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.741366 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.741370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.741372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.741655 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.741770 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.742224 (+ 454us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.743437 (+ 1213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":170,"server-negotiator.queue_time_us":102}
I20260811 07:38:35.748005 22547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 07:38:35.749295 25711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: Bootstrap starting.
I20260811 07:38:35.749675 25433 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "18fd8e3d0df347e691cb7bebf455ff0e"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34936
I20260811 07:38:35.754115 25711 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:35.755345 25711 log.cc:824] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:35.758893 25711 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: No bootstrap required, opened a new log
I20260811 07:38:35.760969 25595 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } attempt: 4
I20260811 07:38:35.763789 25711 raft_consensus.cc:348] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } }
I20260811 07:38:35.764192 25711 raft_consensus.cc:729] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ece8fb90f17642f2a725ac79a3be5da2, State: Initialized, Role: FOLLOWER
I20260811 07:38:35.764648 25711 consensus_queue.cc:260] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } }
I20260811 07:38:35.765666 25717 sys_catalog.cc:455] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.766080 25717 sys_catalog.cc:458] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:35.766903 25711 sys_catalog.cc:564] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [sys.catalog]: configured and running, proceeding with master startup.
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433915, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.253@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
W20260811 07:38:35.774703 25736 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 07:38:35.774792 25602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.761796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43860)
0811 07:38:35.761962 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.761981 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:35.762106 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:35.762716 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:35.762719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:35.763020 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:35.763144 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.763150 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.764258 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.764262 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.765245 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.765261 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.766006 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.766011 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.766139 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.766970 (+ 831us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:35.766993 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:35.769250 (+ 2257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:35.772271 (+ 3021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.772276 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.772279 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.772703 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.773154 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.773157 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.773161 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.773295 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.773959 (+ 664us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:35.773963 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:35.774120 (+ 157us) client_negotiation.cc:769] Sending connection context
0811 07:38:35.774263 (+ 143us) client_negotiation.cc:240] Negotiation successful
0811 07:38:35.774533 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58}
W20260811 07:38:35.774814 25736 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:35.775784 25714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.762125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43860 (local address 127.22.4.252:36383)
0811 07:38:35.762338 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.762345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.762374 (+ 29us) server_negotiation.cc:407] Connection header received
0811 07:38:35.762438 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.762442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.762519 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.762668 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.763328 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.764094 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.765459 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.765815 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.765945 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.769495 (+ 3550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.769505 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.769512 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.769559 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.772038 (+ 2479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.772870 (+ 832us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.772877 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.772879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.773020 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.773429 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.773433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.773435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.773784 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.773902 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.775368 (+ 1466us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.775555 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 07:38:35.773406 25608 master_runner.cc:186] Error getting master registration for 127.22.4.254:46153: OK, instance_id { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" instance_seqno: 1786433914942600 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:38:35.778169 25608 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:38:35.781201 25595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: Bootstrap starting.
I20260811 07:38:35.785876 25595 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:35.787400 25595 log.cc:824] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:35.791774 25595 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: No bootstrap required, opened a new log
I20260811 07:38:35.797638 25595 raft_consensus.cc:348] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } }
I20260811 07:38:35.798062 25595 raft_consensus.cc:729] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04495972e7294821b8c55cc23b858578, State: Initialized, Role: FOLLOWER
I20260811 07:38:35.798635 25595 consensus_queue.cc:260] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } }
I20260811 07:38:35.799629 25741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.799909 25741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:35.800936 25595 sys_catalog.cc:564] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:35.802977 25478 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } attempt: 4
W20260811 07:38:35.809230 25760 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:35.809356 25760 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 11 07:38:35 dist-test-slave-7z32 krb5kdc[25347](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786433914, etypes {rep=17 tkt=17 ses=17}, kudu/127.22.4.254@KRBTEST.COM for kudu/127.22.4.252@KRBTEST.COM
I20260811 07:38:35.809494 25489 master_runner.cc:186] Error getting master registration for 127.22.4.254:46153: OK, instance_id { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" instance_seqno: 1786433914942600 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 07:38:35.813861 25489 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:38:35.816639 25714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.803798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43866 (local address 127.22.4.252:36383)
0811 07:38:35.803977 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.803983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.804002 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:38:35.804124 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.804129 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.804191 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.804271 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.804989 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.805733 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.807240 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.807560 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.807675 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.812086 (+ 4411us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.812092 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.812095 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.812142 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.814140 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.814799 (+ 659us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.814803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.814805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.814938 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.815507 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.815512 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.815516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.815798 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.815914 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.816227 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.816455 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260811 07:38:35.816665 25483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.803619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.22.4.252:36383 (local address 127.0.0.1:43866)
0811 07:38:35.803847 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 07:38:35.803866 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 07:38:35.803989 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 07:38:35.804433 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 07:38:35.804436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 07:38:35.804700 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0811 07:38:35.804824 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.804831 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.805935 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.805942 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.807001 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 07:38:35.807019 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.808311 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.808317 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 07:38:35.808435 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.809772 (+ 1337us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 07:38:35.809795 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0811 07:38:35.811818 (+ 2023us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 07:38:35.814323 (+ 2505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.814328 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.814330 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.814676 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.815197 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 07:38:35.815201 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 07:38:35.815203 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 07:38:35.815384 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 07:38:35.815916 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 07:38:35.815919 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 07:38:35.816041 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 07:38:35.816165 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 07:38:35.816513 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130}
I20260811 07:38:35.820925 25478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e: Bootstrap starting.
I20260811 07:38:35.824272 25478 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e: Neither blocks nor log segments found. Creating new log.
I20260811 07:38:35.825289 25478 log.cc:824] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e: Log is configured to *not* fsync() on all Append() calls
I20260811 07:38:35.828035 25478 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e: No bootstrap required, opened a new log
I20260811 07:38:35.831614 25478 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } }
I20260811 07:38:35.831893 25478 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18fd8e3d0df347e691cb7bebf455ff0e, State: Initialized, Role: FOLLOWER
I20260811 07:38:35.832298 25478 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } }
I20260811 07:38:35.832935 25766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.833261 25766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:38:35.833946 25518 tablet.cc:2369] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:38:35.834024 25478 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: configured and running, proceeding with master startup.
I20260811 07:38:35.834684 25433 raft_consensus.cc:482] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 07:38:35.834810 25433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:35.836477 25433 raft_consensus.cc:504] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } }
I20260811 07:38:35.838434 25552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "04495972e7294821b8c55cc23b858578"
I20260811 07:38:35.838729 25552 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:35.840880 25552 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fd8e3d0df347e691cb7bebf455ff0e in term 1.
W20260811 07:38:35.841418 25786 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 07:38:35.841610 25786 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 07:38:35.842068 25433 leader_election.cc:288] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [CANDIDATE]: Term 1 election: Requested vote from peers 04495972e7294821b8c55cc23b858578 (127.22.4.253:43375), ece8fb90f17642f2a725ac79a3be5da2 (127.22.4.252:36383)
I20260811 07:38:35.842283 25671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ece8fb90f17642f2a725ac79a3be5da2"
I20260811 07:38:35.842303 25394 leader_election.cc:302] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04495972e7294821b8c55cc23b858578, 18fd8e3d0df347e691cb7bebf455ff0e; no voters:
I20260811 07:38:35.842664 25671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 07:38:35.843667 25766 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 07:38:35.844027 25766 raft_consensus.cc:686] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [term 1 LEADER]: Becoming Leader. State: Replica: 18fd8e3d0df347e691cb7bebf455ff0e, State: Running, Role: LEADER
I20260811 07:38:35.844514 25766 consensus_queue.cc:237] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } }
I20260811 07:38:35.844842 25671 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18fd8e3d0df347e691cb7bebf455ff0e in term 1.
I20260811 07:38:35.850610 25766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18fd8e3d0df347e691cb7bebf455ff0e. Latest consensus state: current_term: 1 leader_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.850908 25766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:35.853075 25365 master_runner.cc:263] No leader master found from master 18fd8e3d0df347e691cb7bebf455ff0e
I20260811 07:38:35.853173 25365 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 07:38:35.857583 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.847583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34950 (local address 127.22.4.254:46153)
0811 07:38:35.847744 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.847751 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.847773 (+ 22us) server_negotiation.cc:407] Connection header received
0811 07:38:35.847822 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.847824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.847888 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.847995 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.848801 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.849551 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.850619 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.850992 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.851084 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.853284 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.853289 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.853294 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.853325 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.855297 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.855866 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.855872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.855875 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.855965 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.856294 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.856298 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.856300 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.856588 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.856733 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.857156 (+ 423us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.857325 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 07:38:35.860571 25605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.846467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48520 (local address 127.22.4.253:43375)
0811 07:38:35.846623 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.846629 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.847061 (+ 432us) server_negotiation.cc:407] Connection header received
0811 07:38:35.847270 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.847274 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.847336 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.847390 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.848571 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.849389 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.853853 (+ 4464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.854264 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.854368 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.856280 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.856284 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.856287 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.856318 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.858405 (+ 2087us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.859056 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.859060 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.859062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.859160 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.859499 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.859502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.859504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.859750 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.859868 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.860246 (+ 378us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.860390 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 07:38:35.863377 25800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 07:38:35.865007 25800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 07:38:35.869999 25714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:35.847229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43880 (local address 127.22.4.252:36383)
0811 07:38:35.847514 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:35.847520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:35.859964 (+ 12444us) server_negotiation.cc:407] Connection header received
0811 07:38:35.860179 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:35.860184 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:35.860245 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:35.860301 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:35.861349 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.862061 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.863115 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:35.863445 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:35.863544 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:35.865619 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 07:38:35.865624 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 07:38:35.865627 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 07:38:35.865660 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0811 07:38:35.867589 (+ 1929us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.868196 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.868200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.868203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.868314 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 07:38:35.868657 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 07:38:35.868661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 07:38:35.868663 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0811 07:38:35.869104 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 07:38:35.869237 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:35.869689 (+ 452us) server_negotiation.cc:299] Negotiation successful
0811 07:38:35.869826 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176}
I20260811 07:38:35.889194 25671 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [term 1 FOLLOWER]: Refusing update from remote peer 18fd8e3d0df347e691cb7bebf455ff0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:38:35.889194 25552 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [term 1 FOLLOWER]: Refusing update from remote peer 18fd8e3d0df347e691cb7bebf455ff0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 07:38:35.890200 25766 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:38:35.890443 25788 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 07:38:35.903919 25741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18fd8e3d0df347e691cb7bebf455ff0e. Latest consensus state: current_term: 1 leader_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.904158 25741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:35.906997 25717 sys_catalog.cc:455] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18fd8e3d0df347e691cb7bebf455ff0e. Latest consensus state: current_term: 1 leader_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.907202 25717 sys_catalog.cc:458] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 07:38:35.921703 25638 tablet.cc:2369] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 07:38:35.921854 25766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.922073 25766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:35.922237 25766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.922341 25766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e [sys.catalog]: This master's current role is: LEADER
I20260811 07:38:35.922956 25801 mvcc.cc:205] Tried to move back new op lower bound from 7317233319468744704 to 7317233319304200192. Current Snapshot: MvccSnapshot[applied={T|T < 7317233319468744704}]
I20260811 07:38:35.926041 25741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.926190 25741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:35.927834 25717 sys_catalog.cc:455] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18fd8e3d0df347e691cb7bebf455ff0e" member_type: VOTER last_known_addr { host: "127.22.4.254" port: 46153 } } peers { permanent_uuid: "04495972e7294821b8c55cc23b858578" member_type: VOTER last_known_addr { host: "127.22.4.253" port: 43375 } } peers { permanent_uuid: "ece8fb90f17642f2a725ac79a3be5da2" member_type: VOTER last_known_addr { host: "127.22.4.252" port: 36383 } } }
I20260811 07:38:35.927987 25717 sys_catalog.cc:458] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 07:38:35.928747 25802 mvcc.cc:205] Tried to move back new op lower bound from 7317233319468744704 to 7317233319304200192. Current Snapshot: MvccSnapshot[applied={T|T < 7317233319468744704}]
I20260811 07:38:35.929387 25803 mvcc.cc:205] Tried to move back new op lower bound from 7317233319468744704 to 7317233319304200192. Current Snapshot: MvccSnapshot[applied={T|T < 7317233319468744704}]
I20260811 07:38:35.936662 25800 catalog_manager.cc:1347] Generated new cluster ID: b9f25e3a8c914c38b7cde18ab9493cc1
I20260811 07:38:35.936793 25800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 07:38:35.969556 25800 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 07:38:35.971166 25800 catalog_manager.cc:1504] Loading token signing keys...
I20260811 07:38:35.986167 25800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 18fd8e3d0df347e691cb7bebf455ff0e: Generated new TSK 0
I20260811 07:38:35.987382 25800 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 07:38:36.048517 25484 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.044116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34952 (local address 127.22.4.254:46153)
0811 07:38:36.044298 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.044304 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.046328 (+ 2024us) server_negotiation.cc:407] Connection header received
0811 07:38:36.046903 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.046907 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.046983 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.047056 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.048317 (+ 1261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34952: BlockingRecv error: recv got EOF from 127.0.0.1:34952 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260811 07:38:36.050084 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.045341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48522 (local address 127.22.4.253:43375)
0811 07:38:36.045521 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.045528 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.046585 (+ 1057us) server_negotiation.cc:407] Connection header received
0811 07:38:36.049038 (+ 2453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.049044 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.049121 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.049184 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.049915 (+ 731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48522: BlockingRecv error: recv got EOF from 127.0.0.1:48522 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260811 07:38:36.052350 25714 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.047370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43886 (local address 127.22.4.252:36383)
0811 07:38:36.047527 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.047534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.050913 (+ 3379us) server_negotiation.cc:407] Connection header received
0811 07:38:36.051216 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.051222 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.051294 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.051355 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.052177 (+ 822us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43886: BlockingRecv error: recv got EOF from 127.0.0.1:43886 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260811 07:38:36.057358 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.055798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48524 (local address 127.22.4.253:43375)
0811 07:38:36.055929 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.055933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.056226 (+ 293us) server_negotiation.cc:407] Connection header received
0811 07:38:36.056484 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.056488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.056578 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.056634 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.057230 (+ 596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48524: BlockingRecv error: recv got EOF from 127.0.0.1:48524 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260811 07:38:36.076802 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.075616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48536 (local address 127.22.4.253:43375)
0811 07:38:36.075750 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.075765 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.075783 (+ 18us) server_negotiation.cc:407] Connection header received
0811 07:38:36.075863 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.075870 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.075939 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.076062 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.076652 (+ 590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48536: BlockingRecv error: recv got EOF from 127.0.0.1:48536 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260811 07:38:36.083636 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.081646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48544 (local address 127.22.4.253:43375)
0811 07:38:36.081800 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.081806 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.082088 (+ 282us) server_negotiation.cc:407] Connection header received
0811 07:38:36.082281 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.082286 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.082359 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.082451 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.083474 (+ 1023us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48544: BlockingRecv error: recv got EOF from 127.0.0.1:48544 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260811 07:38:36.092592 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.090865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48546 (local address 127.22.4.253:43375)
0811 07:38:36.091016 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.091020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.091322 (+ 302us) server_negotiation.cc:407] Connection header received
0811 07:38:36.091573 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.091578 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.091649 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.091712 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.092433 (+ 721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48546: BlockingRecv error: recv got EOF from 127.0.0.1:48546 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260811 07:38:36.108728 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.103952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48554 (local address 127.22.4.253:43375)
0811 07:38:36.104104 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.104109 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.107299 (+ 3190us) server_negotiation.cc:407] Connection header received
0811 07:38:36.107570 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.107577 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.107655 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.107724 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.108543 (+ 819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48554: BlockingRecv error: recv got EOF from 127.0.0.1:48554 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
W20260811 07:38:36.130201 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.128401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48566 (local address 127.22.4.253:43375)
0811 07:38:36.128638 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.128646 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.128915 (+ 269us) server_negotiation.cc:407] Connection header received
0811 07:38:36.129101 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.129108 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.129191 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.129340 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.130029 (+ 689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48566: BlockingRecv error: recv got EOF from 127.0.0.1:48566 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
W20260811 07:38:36.171685 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.169644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48572 (local address 127.22.4.253:43375)
0811 07:38:36.169819 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.169827 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.170244 (+ 417us) server_negotiation.cc:407] Connection header received
0811 07:38:36.170447 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.170453 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.170539 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.170685 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.171541 (+ 856us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48572: BlockingRecv error: recv got EOF from 127.0.0.1:48572 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260811 07:38:36.240458 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.238938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48580 (local address 127.22.4.253:43375)
0811 07:38:36.239169 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.239175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.239330 (+ 155us) server_negotiation.cc:407] Connection header received
0811 07:38:36.239610 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.239613 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.239682 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.239782 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.240324 (+ 542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48580: BlockingRecv error: recv got EOF from 127.0.0.1:48580 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
W20260811 07:38:36.373140 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.371510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48594 (local address 127.22.4.253:43375)
0811 07:38:36.371751 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.371757 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.371987 (+ 230us) server_negotiation.cc:407] Connection header received
0811 07:38:36.372202 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.372207 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.372263 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.372363 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.373022 (+ 659us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48594: BlockingRecv error: recv got EOF from 127.0.0.1:48594 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260811 07:38:36.634840 25605 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 07:38:36.633004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48596 (local address 127.22.4.253:43375)
0811 07:38:36.633376 (+ 372us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:36.633384 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:36.633555 (+ 171us) server_negotiation.cc:407] Connection header received
0811 07:38:36.633714 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:36.633717 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:36.633823 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:36.633925 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 07:38:36.634701 (+ 776us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48596: BlockingRecv error: recv got EOF from 127.0.0.1:48596 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260811 07:38:36.776784 25736 catalog_manager.cc:1259] Loaded cluster ID: b9f25e3a8c914c38b7cde18ab9493cc1
I20260811 07:38:36.776908 25736 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: loading cluster ID for follower catalog manager: success
I20260811 07:38:36.779172 25736 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: acquiring CA information for follower catalog manager: success
I20260811 07:38:36.780841 25736 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ece8fb90f17642f2a725ac79a3be5da2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:38:36.811399 25760 catalog_manager.cc:1259] Loaded cluster ID: b9f25e3a8c914c38b7cde18ab9493cc1
I20260811 07:38:36.811532 25760 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: loading cluster ID for follower catalog manager: success
I20260811 07:38:36.814249 25760 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: acquiring CA information for follower catalog manager: success
I20260811 07:38:36.816313 25760 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 04495972e7294821b8c55cc23b858578: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 07:38:37.155658 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:37.150142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48606 (local address 127.22.4.253:43375)
0811 07:38:37.150501 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:37.150505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:37.150529 (+ 24us) server_negotiation.cc:407] Connection header received
0811 07:38:37.150798 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:37.150802 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:37.151012 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:37.151181 (+ 169us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:37.151574 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.152265 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.153329 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.153614 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.153729 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:37.154266 (+ 537us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:37.155017 (+ 751us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:37.155160 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:37.155318 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 07:38:37.155412 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":139,"threads_started":1}
I20260811 07:38:37.165253 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:37.160619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43902 (local address 127.22.4.252:36383)
0811 07:38:37.160930 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:37.160966 (+ 36us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:37.160985 (+ 19us) server_negotiation.cc:407] Connection header received
0811 07:38:37.161120 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:37.161123 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:37.161275 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:37.161428 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:37.161745 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.162374 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.163501 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.163772 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.163919 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:37.164247 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:37.164799 (+ 552us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:37.164928 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:37.165042 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 07:38:37.165108 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":133,"threads_started":1}
I20260811 07:38:37.175173 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:37.169861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43908 (local address 127.22.4.252:36383)
0811 07:38:37.170030 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:37.170036 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:37.170427 (+ 391us) server_negotiation.cc:407] Connection header received
0811 07:38:37.170637 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:37.170641 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:37.170722 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:37.170781 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:37.171329 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.172250 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.173403 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.173671 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.173809 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:37.174133 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:37.174272 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:37.174350 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:37.174884 (+ 534us) server_negotiation.cc:299] Negotiation successful
0811 07:38:37.174985 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:38:37.176151 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:37.170336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48618 (local address 127.22.4.253:43375)
0811 07:38:37.170498 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:37.170503 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:37.171172 (+ 669us) server_negotiation.cc:407] Connection header received
0811 07:38:37.171453 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:37.171458 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:37.171545 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:37.171672 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:37.171925 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.172628 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.174254 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.174633 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.174775 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:37.175428 (+ 653us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:37.175530 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:37.175579 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:37.175800 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 07:38:37.175895 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 07:38:37.176425 25936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 07:38:37.169857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34968 (local address 127.22.4.254:46153)
0811 07:38:37.170163 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0811 07:38:37.170167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 07:38:37.170583 (+ 416us) server_negotiation.cc:407] Connection header received
0811 07:38:37.170724 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 07:38:37.170728 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 07:38:37.171000 (+ 272us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 07:38:37.171150 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 07:38:37.171663 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.172478 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.174227 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 07:38:37.174649 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 07:38:37.174794 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 07:38:37.175354 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 07:38:37.175868 (+ 514us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 07:38:37.175968 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 07:38:37.176137 (+ 169us) server_negotiation.cc:299] Negotiation successful
0811 07:38:37.176235 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":95,"threads_started":1}
I20260811 07:38:37.181452 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 25365
I20260811 07:38:37.214229 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 25489
I20260811 07:38:37.234144 22547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskV24Qp8/build/debug/bin/kudu with pid 25608
2026-08-11T07:38:37Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4163 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (7988 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (387830 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST